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STRATEGIES for concurrent processing of complex 
algorithms in data driven architectures 

By 

John W. Stoughton 1 , Roland R. Mielke 2 , and Sukhamoy Son 3 

ABSTRACT 


This research report is concerned with performance modeling and 
performance enhancement for periodic execution of large-grain, 
decision-free algorithms in data flow architectures. Applications 
include r eal -time iirplementation of control and signal processing 
algorithms where performance is required to be highly predictable. 

The mapping of algorithms onto the specified class of data flow 
architectures is realized by a marked graph model called AIAMM 
(Algorithm To Architecture Mapping Model) . Performance measures and 
bounds are established. Algorithm transformation techniques are 
identified for performance enhancement and reduction of resource 
(computing element) requirements. A systematic design procedure is 
described for generating operating conditions for predictable 
performance both with and without resource constraints. An AIAMM 
simulator is used to test and validate the performance prediction by 
the design procedure. Experiments on a three resource testbed provide 
verification of the AIAMM model and the design procedure. 
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EREFACE 


The purpose of this report is to document research to develop 
strategies for concurrent processing of complex algorithms in data 
driven architectures performed under Grant NAG-1-683 during the period 
May 16, 1988 to May 15, 1989. In this overview, the problem domain is 
described, the motivation for this research is explained, and a 
summary of research activities are presented. The detailed 
description of the investigation is taken from the doctoral 
dissertation by Dr. Sukhamcy Son entitled "Performance Modeling and 
Enhancement for the ATAMM Data Flow Architecture" . 

During earlier grant periods, a computational model called the 
Algorithm To Architecture Mapping Model (ATAMM) was formulated for 
mapping large-grain, decision-free algorithms to a multicomputer data 
flow architecture. Major applications are expected to be real-time 
implementation of control and signal proc e ssing algorithms where 
performance is required to be highly predictable and fault tolerant. 

Of interest is the periodic execution of algorithms . For our 
purposes, an algorithm is expressed as a directed graph where vertices 
(nodes) represent algorithm operations and edges represent data sets 
or signals. Large— grain refers to the assumption that the time 
required to perform algorithm operations is large compared to the time 
required to move data from one node to another. Decision-free refers 
to the absence of data dependent paths in the algorithm graph 


xii 



representation. Hie architecture is assumed to consist of two to 
twenty functional units or resources each having a capability of 
processing, communication, and memory. Hie resources share a common 
global memory which is centralized or distributed. The coordination 
of resources in relation to data and control flow is directed by a 
graph manager. The graph manager also is centralized or distributed. 
Assignment of a functional unit to a specific algorithm node is made 
by the graph manager according to ATAMM rules and a priority ordering 
of algorithm nodes. All assignments are non-preemptive for minimum 
communication cost. In a specific hardware setting, the graph 
manager, globed memory, and functional unit activities together form 
the ATAMM Multicomputer Operating System or AMDS. 

The ATAMM model is important because it specifies a criteria for 
a multicomputer operating system to achieve predictable and highly 
fault tolerant performance, and it creates a platform for 
investigating different algorithm decompositions and implementation 
strategies in a hardware independent context. In earlier reports, the 
use of the ATAMM model is described for determining analytically 
performance bounds and developing an operating strategy for optimum 
tim e performance. In addition, the construction of an ATAMM defined 
data flow architecture and development of simulation and analysis 
tools are reported. During the present grant period, research is 
carried out for performance modeling and performance enhancement for 
the ATAMM data flow architecture. In order to have a predictable 
performance, it is necessary that assignment of algorithm nodes to 
functional units be as much priority independent as possible. This is 
done to avoid the priority inversion problem. Even for small run-time 
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variations of communication delays and execution time variations, a 
low priority algorithm node may be enabled before a high priority 
algorithm node. As the assignment is non-preempt ive , this may 
completely change the graph execution pattern and resource 
requirements. In order to overcome this problem, it is suggested that 
the operating system (AMDS) transform the algorithm graph and control 
input data injection interval so that a functional unit always is 
available for every enabled algorithm node. In other words, even if 
priority inversion changes the order of execution of algorithm nodes, 
graph execution patterns and resource requirements will not be changed 
drastically. Two performance measures, TBIO and TBO, are defined for 
periodic processing of algorithms. TBIO is an indicator of computing 
for an algorithm. TBO is a measure of the time interval between 
algorithm outputs, and the inverse of TBO indicates throughput. The 
j-i mp performance (TBIO, TBO) and the number of required resources 
define an operating point for AMDS. If enough functional units are 
available, optimum TBIO and TBO can be achieved. However, if a 
limited number of resources is available, one must increase either TBO 
or TBIO, or a combination of both. Two key methods for shifting the 
operating point are control of the input injection interval and 
transformation of the algorithm graph. Transformation of the 
algorithm grapg is achieved by adding dummy nodes (transitions) and 
control edges (places) as described below. A dummy node is an 
algorithm node which implements an identity operation and requires 
zero time. It is used as a buffer to provide additional storage space 
for the output of an algorithm node. A dummy node is a pure memory 
operation and does not require a resource. A control edge is an 
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algorithm edge which imposes a precedence relation among two algorithm 
nodes but does not imply data dependency. This type of edge is used 
to delay the execution of a node. Thus, predictable performance is 
achievable even if the number of functioned, units decreases to 1. An 
AIAMM simulator and experiments on a three resource testbed provide 
verification of performance modeling and graph transformation methods. 
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CHAPTER ONE 


DfTRODUCnON 

1.0 Preface 

Algorithm Jo Architecture Mapping Model (AXAM4) is a new graph 
theoretic model frcro which the rules for data and control flew in a 
homogeneous, multiocnputer, data flow architectures may be defined 
[l, 2] . The subject of this dissertation is the investigation of 
concurrent processing in such an AIAMi defined architecture for 
large-grain, decision-free algorithms. Performance modeling, 
performance enhancement, and the development of operating strategies 
for periodic execution of such algorithms are the key research 
objectives. Chapter One is an introduction of ATAMM and a discussion 
of the motivation behind the research. Background for the ATAMM model 
and this res ear ch is presented in Section 1.1. The ocnputational 
problem representation by the ATAMM model is prese n ted in Section 
1.2. The objectives and organization of this d i s se r tation are 
described in Section 1.3. 

1.1 Background 

The principles of oenputer architecture design historically have 
been ba sed upon von Neumann organization [3] . These principles have 
lead to architectures consisting of a single ccnputer in which low 
level machine language instructions perform simple operations on 
elementary operands, and centralized, sequential control of 



2 


c o m pu tation is employed. Despite the fact that electronic components 
are becoming increasingly faster, the desired carputer performance has 
always been much more than that which is obtainable with von Neumann 
organization. Advances in the solid state technology alone are not 
expected to be enough to produce computers to meet the computational 
needs of the future. There is a growing agreement that the next 
(fifth) generation of computers will be based upon non-von Neumann 
structures. 

Recently, a number of new computer architectures have been 
proposed from which a number of computer systems have been built [3] . 

A few examples are Texas Instruments Distributed Data Processor (USA) , 
Cellular Tree Machine of the University of North Carolina-Qiapel Hill 
(USA) , and Manchester Data Flow Cccputer (England) [3] . This work has 
been motivated mainly by three objectives. First, there is the desire 
to increase computer performance through the use of concurrency . 

Second, there is the desire to more fully exploit very large s cal e 
integration (VLSI) in the design of corputers. Third, there is 
interest in new programming methods which facilitate the mapping of 
algorithms onto architectures . These ideas suggest a decentralized 
computer architecture in which a number of i n d e pendent ccmputers are 
to work together. These independent corputers, each having a 
capability for processing, communication, and memory, can be as large 
as a geographically distributed mainframe ocnputer or as small as 
microc omp uters on a single VLSI chip. Unfortunately , strategies for 
interconnecting and programming such architectures based upon von 
Neumann principles have not evolved. It appears that von Neumann 
organization principles are not a de qua t e to a d d r ess the ocnplex issues 
of scheduling, coordination, and ccmrrunicat ion . 



Strategies for control of amputations on decentralized computer 
architectures can be cl ass ified broadly as control flew, deman d 
driven, and data driven. In control flaw ccnputers, explicit flews of 
control cau se the execution of instructions. In demand driven 
architectures, the execution of operations are triggered by the 
requirements of outputs or results. In data driven architectures 
(also known as data flow computers) , the availability of operands 
trigger the execution of operations. Data flew architectures are the 
primary interest of this research beca u se of their suitability for 
concurrent processing of complex algorithms. 

A useful mathematical tool for modeling execution of complex 
algorithms on a data flow decentralized architecture is the Petri 
net. Petri nets were first developed in 1962 by Carl Petri [4], and 
later were identified as a useful analysis tool in the work of Holt 
and Commoner [5] . A comprehensive treatment of Petri nets is 
presented in [6] . One problem with the Petri net model is that it 
tends to be too complicated to analyze. An important subclass of 
Petri net is the marked graph where each place has exactly one 
inoemting and one outgoing arc. Marked graphs can be used to m odel the 
processing of decision-free algorithms [7]. Properties such as 
liveness, safeness, and reachability can be achieved for marked graph 
models [6] . Procedures also exist for expanding and reducing marked 
graphs while preserving these properties [8] . These graph features 
are suitable for modeling the succession of single events such as data 
and status conditions. In this dissertation, the marked graph is used 
as a modeling tool for data driven computations. 

The data flow concept has already attracted the attention of a 
great many researchers. Starting with the work on d a ta flow at MIT by 
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Jack Dennis, a number of data flew oenputers have been built [9] . The 
best strategy for executing an algorithm in these data flew computers 
is machine dependent. However, only a few researchers have tried to 
develop a theoretical model for evaluating computation in a data 
driven architecture [10] . These models do not appear to be adequate 
to address the complex issues of scheduling, coordination, and 
communication . 

There is a nfeed for a simple, but effective, model for data 
driven computations in order to investigate the relative merits of 
different algorithm deccmpos it ions and implementation strategies in a 
hardware independent context. Ongoing research effort at Old Dominion 
University has lead to the development of a new marked graph m odel for 
describing data and control flow associated with the execution of 
algorithms in data flow architectures [2]. The model is identified by 
the acronym ATAMM which represents Algorithm To Architecture Mapping 
Model [11]. Specifications derived fran the model lead directly to 
the description of a data flow architecture and will be called the 
Aram data flow architecture henceforth. The availability of the 
ATAMM model is important for at least three reasons. First, it 
provides a context in which to investigate algorithm decomposition 
strategies without the need to specify a specific ATAMM data flew 
architecture. Second, the model identifies the data flow and control 
dialogue required of any ATAMM data flew architecture which implements 
the algorithm. Third, the model provides a basis for analytically 
calculating performance bounds and developing a methodology for 
improvement in performance. 
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Ihe problem domain addressed by the MWW data flew architecture 
and this research consists of decision-free, large-grain, complex 
algorithms which are assumed to be executed periodically in a 
multicomputer environment. The algorithms cure a ss umed to require 
large confutations which would include such confutations as matrix 
addition, multiplication, etc. The anticipated nulticcrputer 
environment is assum ed to consist of two to twenty identical ccuputers 
or functional units each having a capability of processing, 
communication and memory. The primary reason for such assumptions is 
the objective of implementing control and signal processing algorithms 
in fifth generation multicomputer architectures for real time 
applications on board the proposed Space Sta ti on. The granularity 
level of the algorithm decomposition is kept high to avoid 
communication bottlenecks as observed in many fine-grain data flew 
architectures [12] . The range of functioned, units is suggested due to 
the large— grained aspect of the algorithm decomposition. Of interest 
is the definition of a performance model so that the performance of 
the al gorithms can be evaluated and improved. Also an operating 
procedure is needed for obtaining predictable performance with respect 
to available comp uting elements. 

1.2 Problem Representation by the ATAMM Mode l 

The A1MM model consists of a set of Petri net marked graphs 
which incorporate general specifications of ocnnunicatian and 
processing associated with each computational event in a data flew 
architecture. In this section, the computational problem is 
represented by the ATMfl model. First of all a detailed description 
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of the problem context is stated. This is followed by the def initial 
of the ATWH nr^l consisting of the algorithm marked graph, the node 
marked graph, and the computational marked graph. Sere familiarity 
with Petri nets [6] and marked graphs [13] is assumed. 

A problem description normally results in the definition of a 
function given by the triple (X, Y, F) , where X represents the set of 
admissible inputs, Y the set of admissible outputs, and F: X -> Y the 

rule of correspondence which unambiguously assigns exactly one element 
from Y to each element of X. Associated with a computational problem 
is one or more algorithms. An algorithm is an explicit mathematical 
statement, expressed as an ordered set of primitive operations, which 
explains how to implement the rule of correspondence F. A primitive 
oper ation is a complex confutation. Matrix multiplication and 
addition are examples of primitive operations. In general, a given 
problem can be decomposed by several different primitive operator 
sets. Also, for a given primitive operator set, there are often 
different ordering of primitive operations which can be specified to 
carry out the problem. Of special interest are algorithm 
decompositions in which two or more primitive operations can be 
performed concurrently. For such decompositions, the potential exists 
for decreasing the computational time required to solve the problem by 
increasing the computational resources which implement the primitive 
operations. 

The hardware environment for executing the decomposed algorithms 
is assum ed to consist of R identical computers or functional units 
(FUN's) , where R has a value in the range of two to twenty. These 
computers or functional units are also denoted by the terms 
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"computing element" or "resource". Each functioned unit is a 
processor having local memory for program storage and temporary input 
and output data containers. Each functioned unit can execute any 
algorithm primitive operation. The functional units share a cannon 
global memory (GLM) , which may be either centralized or distributed. 
The coordination of functioned units in relation to data and control 
flow is directed by the graph manager (GM) . The graph manager also 
may be centralized or distributed. Output created by the cxxpletion 
of a primitive operation is placed into globed memory only after the 
output data containers have been emptied. That is, outputs must be 
consumed as inputs to successor primitive operations before allowing 
new dsfcs to fill the output locations. Assignment of a functional 
unit to a specific algorithm primitive operation is made by the graph 
manager only when all inputs required by the operation are available 
in global memory and a functional unit is available. 

An algorithm marked graph (AMS) is a marked graph which 
represents a specific algorithm deccrposition. Transitions and places 
are represented as vertices and directed edges respectively . Vertices 
of the algorithm marked graph are in a one-to-one correspondence with 
each occurrence of a primitive operation. The transition times 
represent the computation times of the respective primitive 
operations . The algorithm marked graph contains an edge (i, j) 
directed from vertex i to vertex j if the output of vertex i is an 
input for vertex j . Edge ( i , j ) is marked with a token if an output 
from vertex i is available as an input to vertex j . By the nales of 
the marked graph, the computation of a vertex can only be done when 
all the incoming edges have a token on them. When constructing an 
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algorithm marked graph, vertices (transitions) are displayed as 
circles, and edges (plaoes) are displayed as directed line segments 
connecting appropriate vertices. The presence of a to k e n an an edge 
is indicated by a solid dot placed on the edge. Source transitions 
and sink transitions for input and output signals are represented as 
squares. Sources for constants are not usually incl uded in the 
algorithm marked graph? however, triangles are used for this purpose 
vrtien necessary. 

TO illustrate the construction of an algorithm marked graph, 
consider the problem of computing the output of a discrete linear, 
time invariant system given a se qu en ce of inputs to the system. Let 
the system be described by the state equation 

x(k) = Ax(k-l) + Bu(k) 


and the output equation 


y(k) = Cx(k) , 

where x is a p-vector, u is an m-vector, and y is an r-vector . The 
primitive operations are defined as matrix multiplication and vector 
addition, and the natural algorithm decomposition resulting from the 
state equation description is selected. The algorithm marked graph 
for this decomposed algorithm is shewn in Figure 1.1. The initial 
mar-wing indicates that initial condition data are available. 

The algorithm marked graph is a useful tool for representing 
algorithms and for displaying data flew within an 
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algorithm. However, the algorithm marked gra[h does not display 
procedures that a confuting structure mist manifest in order to 
perform the computing task. In addition, the issues of control, tire 
performance, arh resource management are not apparent in this graph. 
These important aspects of concurrent processing are included in the 
AIAIW model through the definition of two additional graphs. The node 
marked graph (MC) is defined to model the execution of a primitive 
operation. The computational marked graph (OB) , obtained fron the 
SIC arri the (tc by a set of construction rules, integrates both the 
algorithm requirements aid the computing environment requirements into 

a comprehensive graph model. These additional marked graphs are 

defined below. 

The node marked graph (MC) is a Petri net representation of the 
performance of a primitive operation by a functional unit. Three 
pr imar y activities: reading of input data fron global memory, 
processing of input data to compute output data, and writing of output 
data to global memory, are represented as transitions (vertices) in 
the NM3. Data and control flew paths are represented as places 
(edges), and the presence of signals is notated by tokens marking 
appropriate edges. The conditions for firing the process and write 
transitions of the NM3 are as defined for a general Petri net, while 
the read transition has one additional condition for firing. In 
addition to having a token present on each incoming signal edge, a 
functional unit must be available for assignment to the primitive 
operation before the read node can fire. Once assigned, the 
functional unit is used to implement the read, process, and write 
operations before being returned to a queue of available functional 
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units. The initial marking for an NMG consists of a single token in 
the P rocess Ready place. The NMG model in shown in Figure 1.2. 

A computational marked graph (CMS) is constructed from the AMS 
and the NMG by the following rules: 

1) Source and sink nodes in the algorithm marked graph are 
represented by source and sink nod e s in the CMS. 

2) Nodes corresponding to primitive operations in the algorithm 
marked graph are represented by NMG's in the CMS. 

3) Edges in the algorithm marked graph are represented by edge 
pairs, one forward directed for data flew and one backward 
directed for control flew, in the CMS. 

The forward directed edge goes from predecessor write transition 
to s uccesso r read or sink transition. This forward edge is also shown 
as part of the NM3 where it is the OF and IF edge of the predecessor 
and success or respectively. The backward directed edge goes fretn 
successor read transition to prede c essor r ead or source transition. 
This backward edge is also shewn as part of the NMG where it is OE and 
IE edge of predecessor and successor respectively. The initial 
marking for the edge pair consists of a single token in the forward 
directed place if data are available, or a single token in the 
backward directed place if data are not available. 

The play of the CM3 proceeds according to the following graph 

rules: 

1) A node is enabled when all incoming edges are marked with a 
token. An enabled node fires by encumbering one token frcm 
each incaning edge, delaying for some specified transition 
time, and then depositing one token on each outgoing edge. 
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_NMG J1DGE LABELS 

IF Input Buffer Full 
IE Input Buffer Empty 
DR Data Read 
PC Proceee Complete 
PR Process Ready 
OE Output Buffer Empty 
OF Output Buffer Full 


Figure 1.2. ATAMM node marked graph model. 
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2) A source node and a sink node fire when enabled without 
regard for the availability of a functional unit. 

3) A primitive operation is initiated when the read node of an 
NM3 is enabled and a functioned, unit is available for 
assignment to the NM3. A functioned unit remains assigned to 
an NM3 until caipletion of the firing of the write node of 
the NM3. 

In order to illustrate the construction of a ccnputatianal marked 
graph, the CM3 corresponding to the algorithm marked graph of Figure 
1.1 is shown in Figure 1.3. Ihe computational marked graph is useful 
it clearly displays the data and control flew which must occur 
in any hardware implementation of the algorithm, and beca u se it 
provides a hardware independent context in which to evaluate algorithm 
performance. 

The complete ATM*! model consists of the algorithm marked graph, 
the node marked graph, and the computational marked graph. A 
pictorial display of this model is shewn in Figure 1.4. AIMfl model 
characteristics are described in detail in the Appendix. 

1.3 Objectives and Organization of Dissertation. 

The behavior and performance for periodic execution of oemplex 
algorithms in the ATAMM data flow architecture is investigated in this 
dissertation. The problem domain consists of large-grain, 
dec is ion- free algorithms. The major research objectives are 
threefold. First, a performance model is established. Second, rules 
for transformation of algorithms for performance enhancement and 
reduction of comp uting element requirements are identified. Third, 
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system equation. 
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Figure 1.4. ATAMM model components. 






operating strategies are developed for optimum time performance and 
for sub-optimum time performance under limited availability of 
computing elements. 

The disser tation is organized in five chapters and an appendix. 

In the Appendix AIAMM model characteristics, seme of which are used in 
this dissertation, are described in detail. Definitions of the 
computing environment, performance measures, and evaluation of 
performance bounds and resource requirements are presented in Chapter 
TWo. In Chapter Three, algorithm transformations for improving 
performance, and methods for enforcing desired r e sc xn xjs envelope and 
inducing structural changes in algorithm marked graph are. described. 
Definition, characteristics, and design procedure of operating point 
along with simulation and experimental results are presented in 
Chapter Four. Finally conclusions from this resea r ch and future 
research topics are presented in Chapter Five. 


CHAPTER TWO 


PERFORMANCE MODEL 

2 . 0 Introduction 

A performance model for the ATAMM (Algorithm Jo Architecture 
Mapping Model) data flow architecture is described in this c h a p te r . 

The objective is to determine computing speed, throughput capacity and 
resource (occputing element) need for implementing decision-free 
large-grain algorithms on the ATAMM data flew architecture. The 
computing environment and performance measures are defined in Section 
2.1. In Section 2.2, characteristics of marked graphs, which are 
needed to establish the performance model, are described. Graph 
theoretic lower bounds for the time performance of algorithm marked 
graphs operated in the ATAMM data flow architecture are established in 
Section 2.3. Resource needs are predicted and performance bounds in 
the presence of resource limitations are evaluated in Section 2.4. A 
summary of the chapter is presented in Section 2.5. 

2.1 Performance Measures 

The i m pnr-fraring of the ATAMM model is that it provides a hardware 
independent context in which to investigate the performance of 
^<y-Y-r rcp»~>p^ algorithms as long as the architecture obeys the rules of 
CM3. It is assumed that a decomposed adgorithm is implemented in a 
ATAMM data flow architecture containing R identical resources or 
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functional units. Each functional unit is capable of performing any 
of the primitive operations whose sequence defines the decomposition. 
The tokens on the CM3 indicate the data and control flew that must 
occur in any hardware implementation of the algorithm. A task is a 
sequence of computations as described by the AMS. The computational 
task is applied on all input data from the source node. Task output 
occurs when a corresponding output data token is deposited at the 
output sink node. A task is completed when all confuting associated 
with the task is completed. It should be noted that task output and 
task completion do not always coincide. In many iterative signal 
processing algorithms, ccnputing to generate initial conditions for 
the next iteration often occurs after the output has been calculated. 
Task completion is usually indicated in the AMS or the CMS by the 
return of the graph to some stea dy state initial marking. To use the 
output of an algorithm for control and signal processing applications, 
it is assumed that the task is repeated periodically with new input 
data sets (data packets) . New data sets are injected as input tokens 
from the input source node at a finite interval of tune so that 
exarputing time and resource needs are identical for all data sets. 
Included in this problem class cure iterative algorithms where the 
present task requires input data from previous task calculations. 

Computational concurrency occurs in two ways. First, several 
transitions of the task on individual data set may be performed 
simultaneously. We have referred to this type of concurrency as 
pa rallel corxrurrency because it is the result of inherent parallelism 
in the algorithm. Parallel concurrency has a direct effect on task 
computing speed. It is limited by the number of transitions that can 
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be performed simultaneously for the given task and by the number of 
functioned units available to perform the transitions. Second, 
transitions of the task belonging to different data sets can be 
performed simultaneously in the computing system. This type of 
concurrency is referred to by us as pipeline concurrency because the 
task is repeated for successive data sets, like a pipeline. This type 
of concurrency has a direct effect on throughput capacity. It is 
limited by the capacity of the graph to accomodate additional data 
sets and by the nurtfcer of functional units available to implement the 
algorithm periodically. 

Three performance measures, TBIO, TT, and TBO, are new defined 
for concurrent processing of complex algorithms in ATAMM data flew 
architectures. TBIO and TT are indicators of ocnputing speed for a 
task and thus reflect the degree of parallel concurrency. TBO is a 
measure of time interval between t a sk outputs. The inverse of TBO 
indicates throughput, and thus reflects the degree of pipeline 
concurrency. 

Definition 2.1; TBIO . The performance measure TBIO (time between 
input and output) is the elapsed ocnputing time between a task input 
and the corresponding task output. 

Definition 2.2: TT . The performance measure IT (task time) is the 

elapsed ocnputing time between a task input and the completion of all 
c omp utation associated with that task input. 

Definition 2.3: TBO . The performance measure TBO (time between 

outputs) is the elapsed computing time between successive task outputs 
when the graph is operating periodically at steady state. 

TP illustrate, an algorithm marked graph for an aircraft flight 
simulation is shown in Figure 2.1. S j is the input source 



representing flight plan data. S Q is the output sink representing 
moving map and flight instruments data. Transitions of the graph 
represent activities. Places represent data dependency or precede n ce 
relation. Tokens on places are initial tokens representing initial 
rendition data. As an example, transition 3 represents inertial 
navigation confutation and requires ten time units for processing. 
Time units associated with transitions are relative and are m e a sured 
with respect to a reference. Transition 7 (zero processing time) is 
used to combine outputs of the coordinate transform confutation 
(moving map) and the auto—pilot confutation (control for flight 
instruments) . TBIO is the time to produce the outputs in S 0 for a 
flight plan data. TT is the time to finish all processing for a task 
input. TBIO and TT need not be the same for all problems although 
they are related. TBO is the time between arrived, of successive 
output tokens in the output data sink when the algorithm is executed 
peri odical ly at steady state. 

2.2 Marked Graph Characteristics 

Marked graphs, a class of Petri nets, are used as a device for 
expressing the ATAM4. A marked graph is viewed as a directed graph 
where the vertices are the transitions and the edges are directed 
places. In this section, concept of path and circuit for the marked 
graph is developed. Only directed paths and circuits are of interest 
to t his dissertation. If not mentioned, a path or a circuit of a 
marked graph should always be understood to be a directed path or a 
circuit respectively. Some properties of the marked graph 
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Figure 2.1. An algorithm for flight simulation plan. 
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which are needed to establish a performance model are stated. Also, 
circuits of the CM3 are classified. Let and denote 
transition i and place i respectively. 

Definition 2.4: Direr -t-ed Path. A directed path in a marked graph is 

a finite alternating sequence of distinct transitions and distinct 
directed places with the following property. The sequence begins and 
erris with transitions and every place originates from the immediate 
predecessor transition and ends on the immediate su ccess or transition 
in that seque n ce. 

To illustrate, the sequence Sj, p x , t 1# P 2 , tj, P 3 , t 3 , p 4 , and S 0 
is a directed path in Figure 1.1. Bit the seque n ce t 1# P 2 # Pg» 
t 4 , P5' tj, P 3 , and tj is not a directed path in Figure 1.1 as 
transition 2 is repeated twice in that sequence. 

Definition 2.5; Directed Circuit . A directed circuit in a marked 
graph is the same as a directed path except that beginning and end 
transitions are the same in a directed circuit. 

To illustrate, the sequence p 6 , t 4 , p 5 and tj is a directed 
circuit in Figure 1.1. 

Definition 2 . 6 : Parallel Paths . Parallel paths are directed paths 

which have identical beginning and ending transitions; however, all 
other transitions and places on all directed paths are distinct. 

In Figure 2.2, the sequence t 3 , p 2 , t 2 , P 3 » ^ 3 / p 4 , t 4 , p 5 , and 
tg and the sequence t 3 , pg, tg, p 3 , and tg are parallel paths. 
Definition 2.7; Group Of Paths . Group of paths are a finite number 
of directed paths from a marked graph. 

To illustrate, the sequences t^, P 7 , P 9 # t 4 31x1 fc i' P6' t 6' 

p 8 , t 5 form a group of paths in Figure 2.2. 
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Eeflaitign a.B: path Length . The length of a directed path in a 

marked graph is defined to be the simulation of all the times for 
transitions in that directed path- 

rvafinition 2.9; Circu it Length. The length of a directed circuit in 
a marked graph is defined to be the sunmation of all the times for 
transitions in that directed circuit. 

rvafinition ? Critical Path . The critical path among a grcup of 

paths is the one -which has the highest path length. 

This definition of critical path is identical to the one used in 
task scheduling [14, 15] and project management [16, 17]. 

To illustrate, let T(i) stand for the time of the i 
transition. In Figure 1.1, let T(l) = 4, T(2) = 1, T(3) = 5 and T(4) 

= 6, T(Sj) = 0 and T(S 0 ) * 0. Then, the directed circuit t 2 , 

P 6 , t 4 , p 5 , and t 2 has length 7. The directed path used to illustrate 
Definition 2.4 has length 10. The directed path S I# p x , t p p^ t^, 
p 6 , and t 4 has length 11. These two directed paths form a group of 
paths. In that group of paths, the directed path from Sj to t 4 is 
the critical path. It is to be noted that there can be more than one 
criti cal path in a grcup of paths- 

Property 2.1 . The critical path length of a group of paths is the 
lowest poss ible time to move tokens from the input of the beginning 
transition to the output of the end transition on all directed paths 

of that group. 

This is a property of the critical path known from critical-path 
scheduling [14] and project management [17]. In the context of a 
marked graph, as the token has to move through all the transitions of 
the directed path in order to reach the output of the end transition 
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frcm the input of the beginning transition, the miniitum time required 
is the length of the directed path. Considering all the directed 
paths of the group, the lowest possible time to move tokens on all 
directed paths frcm the input of the beginning transition to the 
output of the end transition is the critical path length. 

Property 2.2 . With unlimited resources, tokens always take time equal 
to critical path length to complete the move frcm the input of the 
beginning transition to the output of the end transition on all 
directed paths of the group. 

This is another property of the critical path known from task 
scheduling [14] and project management [17]. In the context of the 
marked graph, with unlimited resources, a transition can always be 
fired as soon as it is enabled by input data. Therefore, the lowest 
possible time can actually be achieved. Hence, the critical path 
length is the time to move all tokens from the input of the beginning 
transition to the output of the end transition. 

Directed circuits are created in the computational marked graph 
in four different ways. They sue node, process, recursion and 
parallel path circuits. Formal def initials of each kind of directed 
circuit sue presented below along with exanples. 

Definition 2.11: Node Circuit . This is a directed circuit in the CMS 

which is the only internal directed circuit of an NM3. 

To illustrate, the sequence t R , p^p, t p , PpQ, ^vj, PpR' an ^ 
a node circuit in the AIAMM node marked graph model of Figure 1.2. 

One such node circuit in the CMS of Figure 1.3 is shewn in Figure 
2.3(a) . This is the node circuit of transition 1 in the AMS of Figure 
1.1. Node circuits always have one token, as described in the 


Appendix. 
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NMG of transition 1 




Transition 2 Transition 3 



Figure 2.3. Example of node and process 
circuits. 
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ppfinition 2.12: Process Circuit . This is a directed circuit in the 

CM3 which is formed each time an NM3 or source is linked to another 
NM3 or sink. The backward directed place from success o r read or sink 
transition to predecessor read or source transition, along with 
forward directed places frail pr edec essor to su cce ssor create the 
process circuit. 

A prooess cir cuit of Figure 1.3 is shown in Figure 2 . 3 (b) . This 
process circuit is formed when node marked gr aph s of transition 2 and 
3 jQpe linked. Prooess circuits always have one token as des cr ibed in 
the Appendix. 

Definition 2.13: Paralle l Path Circuit. This is a directed circuit 

in the CMS which is created by any two parallel paths in the AMS. The 
circuit is formed by the forward directed places through the NMS'S of 
one Hjypra-oH path and backward directed places from the successor read 
to the predecessor read transition from the NMS's of the other 
directed path. 

To illustrate, the CMS of Figure 2.2 is shewn in Figure 2.4. The 
parallel paths of the AMS form parallel path circuits in the CMS. One 
such parallel path circuit is shown in Figure 2.5(a) . This circuit is 
created by two parallel paths in the Figure 2.2 between transition 1 
and transition 5. 

Definition 2.14: Recursion Circuit . This is a circuit in the CMS 

which is created due to a directed circuit in the algorithm marked 
graph. 

To illustrate, the recursion circuit of Figure 1.3 is shewn in 
Figure 2.5(b). The directed circuit t^, Pg, t 4 , Pg, and tj in Figure 
1.1 translates itself into a recursion circuit in the CMS of 


Process time for 
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Figure 2.4. Computational marked graph for the AMG. 
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Figure 1.3. Directed circuits are created in the AMS mainly due to a 
recursion in computation and hence the corresponding circuits in the 
CM3 are called recursion circuits. 

2.3 Graph Theoretic Performance Bounds 

The process of algorithm decomposition imposes bounds on the 
amount of parallel concurrency and pipeline concurrency possible in a 
given problem. If sufficient computing resources are available, 
operation at these bounds can be achieved. In this section, graph 
theoretic lower bounds on three performance measures are established 
for decomposed algorithms to be operated in AIMM data flew 
architectures. These lower bounds are only a function of the 
algorithm marked graph and the node marked graph. Therefore, 
performance cannot be improved beyond these bounds try increasing the 
number of resources. The remainder of this section is devoted to 
developing lower bounds for these performance measures. 

Let G denote an algorithm marked graph representing a decomposed 
algorithm. The lower bound for TBIO is the shortest time required for 
a data token from the data input source to propagate through the graph 
to the data output sink. Similarly the lower bound for TT is the 
shortest time r equir ed to complete all computing activity initiated by 
the injection of a data from the input source. These shortest times 
are the act ual performance times when only a single data set is 
present in the graph during any time interval (no pipeline 
concurrency) , and as many computing resources as are required are 
available (maximum parallel concurrency) . Under these operating 
conditions, lower bounds for TBIO and TT are calculated by identifying 
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certain largest paths in a graph rtitained fro. the algorithm marked 
graph. This new graph, called the modified algorithm marked graph 
is defined and then used to determine lower bounds for TBIO and 

IT. 

nof i ni on 2 - is : Modifi ed M qo ritm GX3 &- I^t p t be a 

place of G, directed from transition t*. to transition t s , which 
contains a token of the initial marking. The modified algorithm 
marked graph G„ is obtained from the graph G ty the following 

construction rules: 

1) Place p^ is deleted from G. 

2 ) A new place, p iv directed from the data input 
source to transition t s , is added to G. 

3 ) A new output sink Si different fran all other 
output sinks, and a new place Pi 2 , directed from 
transition tj. to S if are both added to G. 

4 ) The above rules are repeated for each place of G 
containing a token of the initial marking. 

Example: The recursion problem of Figure 1.1 is used to generate a 

modified algorithm marked graph as shown in Figure 2.6. Only place 5 
from transition 4 to 2 has an initial token in the algorithm marked 
graph of Figure 1.1. According to rule 1, place 5 is deleted. A new 
place 5-1 is inserted from data input source to transition 2 by rul 
2. Rule 3 is then used to generate a new output sink (S 5 ) and a new 
place 5-2 as shown in Figure 2.6. As there are no more places with 
initial tokens, this completes the procedure to generate a modified 

algorithm marked graph. 
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Figure 2.6. Modified algorithm marked 
graph for Figure 1.1. 




Th<*->ran 2.1; Grach The oretic Lower Bound for TBIQ- let Pi be the 
1 th directed path in fran the data input source to the data 
output sink, and let T^) denote the sum of transition tines for 
transitions contained in P^. Then, 

TBIOj^ = Max {T(P^) } , 

where the maviT rum is taken over all paths between the data input 
source and the data output sink in graph Gj,. 

Proof. T^) is the length of path P if * therefore, Max (T(P i ) ) 
is the length of the critical path from the data input source to the 
data output sink. Fran the properties of the critical path [14, 17], 
TBIOjjj = Max (T(P i ) }. This completes the proof. 

Theorem 2.2: lower Bound for IT. Let Pj^ be the 1 th directed path 

in Gjj f fTm the data input source to any output sink, and let T(P^) 
denote the sum of transition times of transitions contained in P^. 
Then, 


TTjjj = Max (T^) }, 

where the maviTnm is taken over all paths P^ in graph G^. 

Proof. By the construction rules for graph Gj^, a task is initiated 
with an input from the data input source, and is completed when all 
output sinks have accepted tokens. Therefore, IT is the time which 
elapses fran injection of input tokens to the arrival of a token at 
the last fired output sink. Let T(Pj) = Max (T(P^) ) , among all 
P^ in Gj^. Pj is the longest path among all paths front the 
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data input source Sj to any output sink. Therefore, Pj is the 
critical path airong all paths from the data input source to any output 
sink. Hence, by the properties of the critical path [14, 17], TT^ 

_ T(Pj) = Max{T(P^) }, where the xnaxinum is over all paths P^ in 

Gjj. This carpi etes the proof. 

To illustrate the application of Theorem 2.1 and Theorem 2.2, 
TBIOlb and TTlb are computed for the algorithm marked graph shewn 
in Figure 1.1. For this example, the following transition times are 
assumed: T(l) = 4, T(2) = 1, T(3) = 5, and T(4) - 6 . The modified 

algorithm marked graph corresponding to Figure 1.1 is shown in Figure 
2.6. The modified algorithm marked graph contains two paths directed 
from the data input source Sj to the data output sink S Q . Path 

P 1 is the sequence t 3 , p^ ^ ' P3' and ^3 T ^ p l^ ” 10 * P 2 

is the sequence tj, P 3 , and t^ with T(P 2 ) = 6 . Since T(P X ) > T(P 2 ) , 
path P x determines the lower bound for TBIO and TBIO^ = 10. The 
modified algorithm marked graph contains two additional directed paths 
from the data input source Sj to the output sink S 5 . Path P 3 is the 
sequence tj_, p 2 , ^ , p 6 , and t 4 with T(P 3 ) - H- Path P 4 is the 
sequence t*, P 6 , and t 4 with T(P 4 ) - 7. Since T(P 3 ) is the highest, 
path P 3 determines the lower bound for IT and TT^ - 11. 

Next a lower bound for the performance measure TBO may be 
determined. Let G be an algorithm marked graph representing a 
decomposed algorithm. It is assumed that the operating conditions for 
G are set to maximize pipeline concurrency. That is, data tokens are 
continuously available at the data input source, and as many computing 
resources as needed can be called to perform primitive operations. 

The graph G is executed periodically and TBO^ is the shortest time 
possible between successive outputs. 



r^nrrm 2.3: o-aph Theoretic Ipwep pound for T BQ- iBt Gc be a 
cxirpatational marked graph and let be the i directed circuit 
in G c . The notation T^) denotes the sum of transition times of 
transitions contained in q, and Mfq) denotes the number of 
tokens contained in q. Then, 


TBOj_g = Max (T(q) / M(C^) } , 


vfcere the maxiMO is taten over ell directed circuits ih G. The 
circuits Which determine will be celled critical circuits of 

the CM3. 

Proof. Without loss of generality, let t f be the output transition 
i„ g c so that an output is produced each time tf cccpletes 
firing. TBOjjj is then the minimum firing period of transition 
t f . By consistency property of the Appendix, Gc is consistent so 
that all transitions of G c fire periodically with minimum period 
-IBOuj. It is shown in [18] (pp. 58-60) that the minimum firing 
period of each transition of a marked graph is given by Max 
(T(C i )/M(C i ) ), where the maximum is taken over all directed 
circuits q in G. Therefore, the theorem follows. 

The algorithm marked graph shown in Figure 1.3 is used to 
illustrate Theorem 2.3. The CM3 contains many directed circuits. 
However, the recursion circuit which contains all NMS nodes of 
transitions 2 and 4 has only one token and maximizes the ratio 
T(C i )/ Mfq) . Therefore, the shortest time possible between 
successive outputs in this graph is TBO^ = 7. 
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2.4 Resource Requirements 

The performance bounds of the last section assume availability of 
a resource for each transition to fire when enabled. Therefore, graph 
theoretic performance bounds are absolute bounds provided sufficient 
resources are available to meet the firing requirements. However, for 
insufficient resources, performance cannot reach the graph-theoretic 
bounds. The number of resources (R) of an ATAM4 data flew 
architecture imposes bounds on performance of an algorithm marked 
graph. In this section, characteristics of resource usage, maximum 
resource requirement, and resource imposed performance bounds are 
investigated. Formal definitions of computation, graph execution, and 
resource requirements are stated. Definitions and r es u l ts are 
illustrated with examples. 

Definition 2.16: TC . Total amputation (TC) is the sum of all 

transition times of an algorithm marked graph. 

Definition 2.17; TPC . Total Forward amputation (TFC) is the sum of 
all transition times that appear in the forward paths frcm the data 
input source to the data output sink of the mo d i fied algorithm marked 
graph. 

Definition 2.18: TBC . Total Backward Computation (TBC) is the sum of 

all transition times that do not appear in the forward paths from the 
data input scuroe to the data output sink of the modified algorithm 
marked graph. 

Lama 2.1 . TC is the sum of TFC and TBC of an algorithm marked graph. 
Proof. With the notation of Definitions 2.16, 2.17, and 2.18, 
transitions which constitute TPC and TBC are mutually exclusive and 
collectively exhaustive of all transitions of the algorithm marked 


graph. Henoe, the sum of all transition times of the algorithm marked 
graph equals the sum of transition times for both transitions on the 
forward paths and not on the forward paths from the data input source 
to the data output sink of the modified algorithm marked graph. 
Therefore, TC equals the sum of TPC and TBC. This ocnpletes the 
proof. 

Definition 2.19: Ocnputer Time . A unit of Ccnputer Time is defined 

to indicate one functional unit available over one unit of time. 

To illustrate, if two functional units are used for three units 
of time, six units of ocnputer time are used. 

Definition 2.20: Ocrcutiro Capacity (T) . Confuting Capacity (CC) is 

the total available units of ocnputer time over an interval of time T. 

To illustrate, for a time interval of T, the ccrputing capacity 
of an AIAMM data flow architecture with R functioned units is given by 
R * T. Thus CC (T) = R * T. 

Definition 2.21: Ocrcutinq Effort (T) . Confuting Effort (CE) is the 

total used units of ocnputer time over an interval of time T. 

To illustrate, for a time intervad of T and R functioned units, 
let T^ be the number of time units the i^ 1 functioned unit is 
used. Then T^ * 1 = T^ units of ocnputer time is the ccrputing 
effort due to the i** 1 resource in intervad T. Thus the ccrputing 
effort due to R resources is given by 

R 

CE (T) = 2 (T a ) 
i=l 


units of ocnputer time. 
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jgrrma 2.2 . For any nunfaer of functional units and any interval of 
time, caput ing effort is always less than, or equal to, ooputing 

capacity. 

Proof. With the notation of definitions 2.20 and 2.21, 


CC (T) = R * T 
R 

CE (T) = Z (T^) , 
i=l 

where T L is the nuntoer of time units the 1 th functional unit was 
used in time interval T. So cannot be more than T [15] . Hence, 
CE(T) < CC(T) . This carpi etes the proof. 

r*>fimtion 2.22: P ogr,,rrv> - utilization III- The Resource Utilization 

(PU) of functional units over a time interval T is given by the ratio 
of computing effort to confuting capacity over that time interval. 

Thus, 


RU (T) = CE (T) / CC (T) . 

T arena 2.3 . Resource Utilization (RU) over a time interval T is always 
greater than, or equal to, zero tut less than, or equal to, 1. 

Proof. By definition, resource utilization is a ratio of caaputing 
effort to capacity. With the notation of Definitions 2.20 and 2.21, 

T . > 0 , T > 0. So CE(T) > 0. CC(T) = R * T > 0 as the ATWM data 
flow architectures must have at least one functional unit. So RU(T) > 
0. Also as CE (T) < CC (T) , FD (T) < 1. This completes the proof. 



Definition 2.23: Total Computing Effort (TCE) . TCE is defined to be 

the ccrputing effort required to execute once all transitions of an 
algorithm marked graph. 

lemma 2.4 . TCE equals TC units of ccnputer time. 

Proof. With the notation of Definitions 2.16, 2.21, and 2.23, 

R 

TCE = CE(T) = E (T^) 
i=l 

= TC 

units of ocnputer time as total ccnputation to execute all transitions 
of the AM3 once is TC. This ccnpletes the proof. 

Definition 2.24: Total Forward Concuti na Effort (TPCE) . TPCE is 

defined to be the computing effort required to execute once all 
transitions on forward paths from the data input source to the data 
output sink of the modified algorithm marked graph. 

Tama 2.5 . TPCE equals TFC units of computer time. 

Proof. The proof is similar to that of Lama 2.4. 

With the above definitions and lemas regarding ccnp utation of a 
task, it is now intended to establish resource imposed bounds on the 
c crputing time of a task. The following two theorems state the 
minimum possible value of TT and TBIO for an ATAhM data flow 
architecture of R resources. 

Theorem 2.4: Minimum TT for R Resources . The mini m um value of TT for 

an algorithm marked graph operated with R resources is always greater 
than, or equal to, TCE / R. 

Proof. TT is the cc r p uting time to ccnplete all oanputation 
associated with a task input. For a time interval of TT, the 
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computing capacity of R resources is R * TT. The total oceputatic*! 
for any task input is the execution of all transitions of the 
algorithm marked graph once and hence, equals TC. The corresponding 
ccmputing effort is ICE. By Lenina 2.2, R * TT > TCE, or TT > TCE / R 
[19], This cxmpletes the proof. 

■nwrem 2.5: Minium TBIO for R BesCTTCgS- H* MinijMn value of TBIO 

for an algorithm .narked graph operated with R resources is always 
greater than, or e q u a l to, TFCE / R. 

Proof. TBIO is the cxmputing time to generate data output for a 
task. For a time interval of TBIO, the cxmputing capacity of R 
resources is given by R * TBIO. In order to generate data output, all 
transitions on all the forward paths fran the data input source to the 
data output sink in the modified algorithm marked graph nust be 
executed once. The ocnputaticn involved is TFC and the corresponding 
computing effort is TFCE. By Lenina 2.2, R * TBIO > TFCE [19], or 
TBIO > TFCE / R. This completes the proof. 

-IWo graph execution features (GPST and TCP) and two hardware 
usage measures (REST and TEE) are now defined for predicting resource 
requirements. GPST describes the execution of transitions of the 
algorithm narked graph for a single data packet. REST is the 
description of the resource usage to process one data packet. TGP and 
TEE are the graph execution description and resource usage envelope 
when the algorithm marked graph is executed repeatedly and 
periodically. 

Definition 2.25: GPST . GPST (graph play for a single task input) is 

a drawing depicting beginning, duration, and end of execution for each 
transition of the task when operated for a single data packet. 



Definition 2.26: TCP . TCP (total graph play) is a drawing depicting 

beginning, duration, and end of execution for each transition of each 
task input at steady state when the AMS is execu t ed periodically with 
an input data injection interval of TBO. 

Definition 2.27; PEST . REST (resource envelope for a single task 
input) is an envelope of resource usage by a single data packet 
between the time of task input and the completion of all oonputation 
associated with that task. 

Definition 2.28: IRE . TRE (total resource envelope) is an envelope 

of resource usage to execute the graph at steady state with input 
period TBO. 

Definition 2.29: Construction of GPST and REST . GPST and REST are 

generated by firing every transition in the algorithm marked graph at 
the earliest possible moment assuming unlimited resources and a single 
task input. Graph play is generated by depicting execution of all 
transitions in every time interval. Symbols (<, >) sire used to shew 
the beginning and the end of execution for a transition respectively. 
The resource usage envelope is obtained by counting the number of 
computing resources used during each time interval. 

Example. Consider the algorithm marked graph df Figure 2.7. 
Transitions 1, 2, and 4 have duration of one time unit. Transitions 
3, 5, and 6 have duration of two time units. The graph is played 
according to Definition 2.29 and the GPST is shewn in Figure 2.8(a) . 
The need for resources is the same sis the number of active transitions 
in each time interval. The REST is computed by counting the number of 
resources used in each time interval and is shown in Figure 2 . 8 (b) . 


4\ 1 /\Place 7 

x^r 


Figure 2.7. Algorithm marked graph for illustration 
of 6PST and REST. 
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Figure 2.8. (a) GPST. (b) REST. 
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Now suppose the algorithm is executed periodically. Assume that 
the input data injection interval is long enough so that every data 
packet executes the graph as the GPST and needs resources over the 
task time as given by the PEST. As a result, the algorithm is 
executed with a input period equal to output period TBO. The total 
resource envelope (TEE) is to be determined then by adding the 
resource needs of the concurrently pro ces s e d data packets. The total 
graph play (TCP) is generated by drawing the execution of transitions 
from all the concurrently processed data packets. It is shown in the 
following two theorems that TEE and TCP are periodic with period TBO. 
If REST and GPST are divided from the beginning in sections of TBO 
tiine units, these sections are shown to be the contributions from the 
consecutive concurrent data packets towards a period of TPE and TCP. 

As an example, GPST and REST of Figure 2.8, are divided in sections of 
TBO = 2 time units . Section as well as data packet numbers are 
represented by the integer variable b. To illustrate, data packet 2 
has been injected two time units before data packet 1. Moreover, 
transition 3, 2 for data packet 0, transition 5, 4 for data packet 2 
and transition 6 for data packet 3 are executed concurrently at steady 
state requiring a total of five resources. 

Theorem 2.6 . When the algorithm marked graph is operated periodically 
for input period TBO with all data packets requiring resource 
envelopes identical to REST, the total resource envelope at steady 
state is periodic with period TBO and one period of TRE is generated 
by the s ummat ion of sections of REST of width TBO as follows. 

Let REST (x) represent the resource envelope for a single task 
input where REST (x) = 0 for x > TT. Let the origin of time axis (t) 



at steady state be the injection of a data packet. let THE (t) be the 
value of to tal resource requirement at time t. Let b represent the 
<xrcurrently processed data packets at time t. A period of TRE(t) is 
then given by 


TOE (t) = 2 REST (t + b * TBO) , 
b 


where 


0 < t < TBO 
0 < b < [TT / TBO] . 

Proof. By the rules of operation, data packets are injected and 
outputs are generated at the interval of TOO at steady state. 

Consider three consecutive data packets P, Q, and R injected at 
t = K * TOO, (K+l) * TOO and (K+2) * TOO respectively, where K is a 
positive integer. Let d be a time unit in which the total resource 
requirement is desired. Let s denote the time between d and time for 
the last data packet injection. Suppose d is a time between the 
injection of data packets P and Q. Thus K * TBO < t < (K+l) * TOO, 
and s = t - (K * TOO) . TOE(t) in this interval is made of REST's due 
to Ha+a packet P and previous data packets whose ocnputations are 
ccrpleted after P has started. As all data packets have resource 
envelope identical to REST of duration TT, any data packet which is 
injected TT or more time before P has no effect on TOE in this 
interval. Consequently, the total number of concurrently processed 
data sets creating TOE(t) in this interval is given by [TT / TBO] . 


Hence, let the range of b be 0 < b < [TT / TBO] ; b is an 
integer. TRE(t) for tire interval between P and Q is then the 
summation of the resource requirements for these cxrcurrently 
processed data packets. Let b — 0 identify task input P whose 
contribution to TOE (t) is REST (s) . The data packet which has 
started TBO tine units before P will contribute REST (s + TBO) and is 
identified by b = 1. In general, a data packet vhidi is injected 
b * TBO time units before P is identified by the d at a packet number b 
and contributes REST (s + b * TBO) to TRE (t) . Therefore, sumning 
PEST (s + b * TBO) over the entire range of b for the concurrently 
processed data packets will give the corresponding TRE (t) . The data 
packet corresponding to the largest b may contribute to TRE(t) for 
only a partial interval. As REST (x) = 0 f or x > TT, 

REST (s + b * TBO) properly represents the contribution due to the 
data packet corresponding to the largest b. Therefore, TRE (t) at d 
be twee n P and Q is given by the following equation, 

TRE (t) = 2 REST (s + b * TBO) 
b 

=Z REST (t - K * TBO + b * TBO) (2.4.1) 
b 


where 


K * TBO < t < (K +1) * TBO 
0 < b < [TT/TBO] . 


Now let d be a time unit t + TBO from the origin. As d now is a time 
unit between date packet injection Q and R, s ■ (t+TBO) - (K+l) *TBO. 
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By s imi lar arguments as before, 

IRE (t + TBO) = E REST (s + b * TBO) 
b 

=S REST { (t+TBO) - (K+l) *TBO + b * TBO} 
b 

= s REST (t - K*TBO + b*TBO) 
b 

» IRE (t) , 

from equation (2.4.1) . Thus, TRE(t) is periodic with period TBO. 
Hence, it is sufficient to specify IRE (t) for one period only; let s 
= t, or K = 0. Modifying equation (2.4.1) we get, 

IRE(t) = E REST (t + b * TBO) 
b 


where 


0 < t < TBO 
0 < b < fTT/TBO] . 

Thus, one period of IRE(t) is generated by the sunmatian of the 
sections of REST (x) of width TBO, starting from x = 0. Ihe sections 
are identified by the corresponding value of b. Ihis ccnpletes the 
proof. 

Theorem 2.7 . When the algorithm marked graph is operated periodically 
for input period TBO with all data packets executing the AMS as GPST, 
total graph play at steady state is periodic with period TBO and one 



period of TCP is generated by the overlapping of sections of GPST of 
width TBO as follows. 

Let GPST (x) represent the graph play for a single task input 
where 0 < x < TT. Let the origin of time axis (t) at steady state be 
the injection of a data packet. Let TCP (t) be the total graph play 
at time t. Let b represent the concurrently processed data packets at 
time t. A period of TCP (t) is then given by, 

TCP(t) = Z GPST (t + b * TBO) 
b 


where 


0 < t < TBO 
0 < b < [TT / TBO] . 

Proof. The proof is similar to Theorem 2.6 with one exception, 
unlike REST, sections of GPST of width TBO represent portions of graph 
play for successive data packets which overlap to form TCP at stea dy 
state. Hence, instead of adding sections of GPST, one period of TCP 
should be constructed by overlapping sections of GPST with each 
section being identified separately by the value of b. If two values 
of b are i and i+1, it mean s data packet i+1 is injected TBO time 
units before data packet i. This carpi etes the proof. 

Example. One period of TCP and TRE is constructed for the AMS of 
Figure 2.7 according to Theorem 2.6 and 2.7 with an input period TBO 
of two time units. GPST and REST of Figure 2.8 are divided in 
sections of width two time units as shewn in Figure 2.8 by the dotted 
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lines. Figure 2.9 shows the TCP and TOE for input period TBO of 2. 

Time t is any time when a new data packet is injected at s teady 
state. In the TCP, the superscript of transitions indicate the value 
of b (data packet nuntoer) . Data packet 1 is injected TBO time units 
before data packet 0 . 1 (0) and represent the execution of 

transition l and 5 for the data packet 0 and 1 respectively in Figure 
2.9(a) . The TCP indicates that 5 (1) begins after the completion of 
l(0) # £3 jjj GPST, (<, >) arrow symbols indicate the beginning and 

end for execution of a transition respectively. In Figure 2.9(a) , 
transitions 3 <°>, 5 < x) , and 6 < 2 > have started in this period but 
did not end. Similarly 3 (1) , 5< 2) , and 6 < 3 > have been cccpleted 
in this period but did not start in it. The resource usage in the 
four sec tions of PEST in order of increasing b are (1, 2) , (1, 2) , 

(1, l) , and (1, 0) . One period of TOE is calculated by adding the 
four sect ions of PEST. The total resource need in one period of TOE 
is (4, 5) as shown in Figure 2.9(b) . It is to be noted that TOE oculd 
also have been calculated from TCP by counting the number of active 
transitions in eadi time interval. 

Larma 2.6 . Confuting effort in one period of TOE is TCE at steady 
state when the algorithm marked graph is operated periodically with an 
input period of TBO. 

Proof. As the algorithm marked graph is operated periodically, 
ccrputing effort in every period is the same. Ccnputing effort in a 
period TBO of TOE will equal TCE as one task output is generated in 
every TBO time units. This ocnpletes the proof. 

iPHim 2 . 7 . Resource Utilization (FU) in one period (TBO) of TOE is 


given by (TCE / (R * TBO) ) . 
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Figure 2.9. For TBO-2. (o) Total graph play. 

(b) Total resource envelope. 
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Proof. By Lama 2.6, computing effort in one period (TBO) of TEE is 
TCE. Computing capacity in the TBO time interval is R * TBO. By 
definition then, resource utilization is {TCE / (R * TBO) ) . This 
completes the proof. 

Exairple. Consider the REST as shown in Figure 2.10(a) with TT = 7, TC 
= is (ignore the dotted lines) . The peak of REST is 4 which indicates 
that the ATAMM data flow architecture requires at least four 
functional units to process the task according to the REST in seven 
time units. Let TBO = 3. Tasks are initiated and outputs are 
generated at the interval of three time units with all having 
identical REST at steady state. TRE is calculated from Theorem 2.6. 
Dividing REST from the beginning in sections of width TBO, as in 
Figure 2.10(a), with the dotted lines, (1, 1, 2), (4, 3 , 3), and 
( 1 , o, 0 ) are the contributions of three overlapping task inputs to a 
period of TRE. Adding three sections of REST, a period of TRE is 
given by (6, 4, 5) and is shown in Figure 2.10(b). The computing 
effort in three time units of TRE is 15 as claimed by Lemma 2.6. 

Since the peak of TRE is 6, a minimum of six functional units is 
required to operate an algorithm marked graph with REST of Figure 
2.10(a) and TBO = 3. By Lenina 2.7, resource utilization (RU) for six 

functional units is given by (15 / (6*3)}= .833. 

With the help of above lemmas, the resource imposed bound on TBO 

is established in the following theorem. 

2.8i MiTvinun TBO for R Resc urs^- Ihe minimum value of TBO 

for an algorithm marked graph operated periodically with R resources 

is ail ways greater than, or equal to, TCE / R. 

Proof. By Theorem 2.6, the total resource envelope is periodic. By 
lema 2.6, the computing effort needed in period TBO is TCE. The 
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Flours 2.10. (o) Resource envelope for a single 

task input, (b) Total reeource 
envelope for TBO*^. 



53 


ccrputing capacity for time interval of TBO is R * TBO. By Iertma 2.2, 

R * TBO > TCE. Hence, TBO > TCE / R. This completes the proof. 
rnmiiarv 2.8.1 . The minimum value of resource requirements (R) for a 
desired TBO is bounded by [TCE / TBOl when the graph is 
operating periodically at steady state. 

Proof. As TBO > TCE / R, it follows that R > TCE / TBO. Since R is 
an integer, R> pTCE / TBO] . This completes the proof. 

Example. Consider the algorithm marked graph of Figure 1.1 and the 
corresponding modified algorithm marked graph of Figure 2.6. let T(l) 

= 4, T(2) = 1, T(3) = 5, and T(4) =6. The sum of all transition 
ti mes are 16. Hence, TC = 16. TPC and TBC are calculated from the 
modified algorithm marked graph. Transitions 1, 2, and 3 appear in 
the forward paths from Sj to S Q . Therefore, TPC = T(l) + T(2) + 

T(3) = 10. As only transition 4 does not appear in any of the forward 
paths from data input source to data output sink, TBC = T(4) = 6. 

Also, TTC and TBC add up to TC. If only two functional units are 
available, the minimum values of TT, TBIO, and TBO are 8, 5, and 8 
respectively. For a TBO of 7, the minimum R is T TCE / TB0 1 = 3 ' 

2.5 Sunmary 

The conputing environment and performance measures in the AIAMM 
data flow architecture are established. Graph time performance is 
expressed by time between input and output (TBIO), task time (TT) , and 
time between outputs (TBO) . The modified algorithm marked graph is 
defined to ccnpute lower bounds for TT and TBIO. lower bounds for the 
performance measures are calculated analytically from the modified 
algorithm marked graph and the computational marked graph with the 



assumption that a functioned unit is available for every enabled 
transition to fire. The availability of a limited number of 
functional units is then considered. The modified algorithm marked 
graph is used to distinguish between forward ocnputation (TPC) and 
backward confutation (TBC) and to establish their relation to total 
ccmputation (TC) . Confuting capacity, ocnputing effort, and resource 
utilization are defined. The range of values for performance measures 
are established assuming that the AIAMM data flow architecture has 
only R functional units. The algorithm marked graph execution for a 
single task input or data packets periodically are defined in terms of 
GPST and TCP. The requirements of functional units to process a 
single task input or data packets periodically are expressed by REST 
and TRE. Resource utilization is defined; construction rule for GPST 
and REST are defined; and properties of TRE are described. 
Methodologies for generating TRE and TCP are established. All 
definitions and results are illustrated with examples. 



CHAPTER THREE 


ALGORITHM TRANSFORMATION 

3 . 0 Introduction 

The lower bounds for performance measures of an algorithm marked 
graph are developed in Chapter Two. One of the two remaining 
important problems concerning performance measures is considered in 
Chapter Three. Of interest is the potential of transforming an 
algorithm narked graph, with or without decomposition, in order to 
decrwgg lower bounds for performance. Investigation is also carried 
out to use transformations to reduce resource re q u ir ements, enforce 
periodicity in execution, and provide structural changes in the 
algorithm marked graph. All required transformation techniques, 
including an investigation of their usefulness and limitations, are 
described in this chapter. Algorithm transformation techniques are 
defined and elaborated in Section 3.1. Applications of algorithm 
transformations for performance improvements and reduction of resource 
requirements are discussed in Section 3.2. A steady sta t e periodic 
execution of algorithm narked graphs is realized in Section 3.3. 
Structural changes of algorithm marked graphs are considered in 
Section 3.4. A summary of the chapter is presented in Section 3.5. 

3.1 Algorithm Transformation Guidelines 

The aim of this section is to define algorithm transformation 
techniques and illustrate their significance. Algorithm 
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transformation is defined to be a process to change sane features of 
an algorithm marked graph while preserving its equivalence in 
captations. In other words, algorithm transformations produce a new 
MG which is equivalent to the original AMS tut better in sane 
respect. The primary objectives are to improve time performance and 
lower resource requirements through algorithm transformation. 
Therefore, algorithm transformation techniques which can lower 
critical path length, lower time per token for the critical circuit of 
the CMS, lower resource requirements, and enforce periodicity in the 
execution of the AMS are of great interest. A formal definition of 
equivalency of two algorithm marked graphs and algorithm 
transformation techniques are stated and explained belcw. 
rv^imtion 3-1; Equival e ncy Of Two Algorithm tertefl grafts - IVro 
algorithm marked graphs are equivalent if they map any set of input 
variables into the same set of output variables and produce an 
identical output sequence for an input sequence. 

Definition 3.1 specifies the allowable transformations. An 
algorithm marked graph can be transformed as long as the new AMG is 
input-output equivalent with the old one. It is to be noted that if 
the ccnputatians of transitions and data dependency among the 
transitions of the original AMG are not altered, the transformed AMG 
will remain input-output equivalent with the original AMG. 

Definitions 3.2 through 3.5 describe fcur transformation techniques 
which are based on this observation. 

rvafinition 3-3: Control Place . A control plaoe is any place in the 

algorithm marked graph whose deletion generates an equivalent 
algorithm marked graph. 
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A control place is an artificial place in the sense it is not 
necessary for the correctness of an algorithm. A control place 
imposes a precedence relation among two transitions. The control 
place needs to be initialized by an initial token if it creates a 
circuit in the algorithm marked graph. The designer inserts a control 
place in the algorithm marked graph to delay the firing of a 
transition. All places in the AMG other than control places will be 
called active places henceforth. If broadcasting is used to transmit 
data between transitions, insertions of control places are not going 
to change read and write times of transitions. Also, control places 
need not transmit data vectors; therefore they can be implemented at 
very low oocmonication cost. Thus for analyses purposes, insertion of 
control places in an AMG will be assumed not to increase read and 
write times of transitions. 

r^fi nil-ion 3 nimnv Transition. A durany transition is any 
transition in the algorithm marked graph which is not required for 
executing a primitive operation. 

A durtiny transition is a redundant transition in the sense that it 
is not required for computation. However, it can be used to control 
operation or improve performance. All transitions other than durany 
transitions will be called active transitions henceforth. A durtmy 
transition can act as a buffer to provide storage for the output of 
any transition. Such buffers will be shown to be needed at times when 
the algorithm marked graph is operated periodically. A dummy 
transition can be used to combine input or output data vectors in 
order to create single input or output vectors respectively. Another 
application of a durtmy transition is as a delay operator for holding 



firing of one, or a grot?) of, transitions. Read and write time for 
the NM3 of a dummy transition depend an implementation and data 
length, but should be less, or equal to, read or write times of an 
active transition of equal data length respectively. A dummy 
transition has zero process time when it is used as a buffer » it has a 
very small process time when it is used for cartoning data vectors. A 
dummy transition as a delay operator has a process time corresponding 
to the amount of delay needed. As operations are restricted to large- 
grain algorithms, read and write times are expected to be 
significantly smaller than the process time of an active transition. 
Thus for analyses purposes, a dunmy transition will be a ss u m ed to have 
zero tins when it is used as a buffer or for combining data vectors. 
Also, it will be assumed that a dummy transition for applications 
other than a delay operator does not require a resource beca u se a 
resource is required to implement such a dunmy transition for a very 
short time. A dunmy transition for delay application has not been 
explored in detail in t his dissertation, but poses am interesting 
topic for future research. 

Definition 3.4: Predefined Token . A predefined token is any initial 

token on a place of the algorithm marked graph. 

A predefined token indicates the presence of a precomputed 
initial data or initial control. A predefined token is necessa r y at 
times for execution of the task and for forward flew of data. 
Definition 3.5: Decomposition of a Transition . Decomposition of a 

transition in the AMS is to replace the transition by an equivalent 
marked graph of a group of transitions. 

The transition decomposition of Def initial 3.5 is to distribute 
the computation of a transition among a group of transitions in order 



to reduce the original transition time. This is important because 
large transition tin ?** are major contributors to critical path length 
and time per token of critical circuits. It should also be noted that 
the decompositions of transitions are not always re a so n able or 
possible due to added ccramunication cost, higher resource 
requirements, and transition characteristics. Serial, or a 
combination of serial and parallel, decompositions of a transition 
tends to decrease TBO^ significantly while TBIOj_g does not 
improve much and can even increase due to added serial communication 
time. In those cases, a proper decomposition is dependent upon the 
relative importance of TBO and TBIO. Pure parallel decomposition of 
transitions decrease both TBOjjj and TBIOjjj. 

Subsequent sections of this chapter will develop a theoretical 
basis for the applications of control places, dunmy transitions, 
init ial token and decomposition . A software program, call led Ttime 
[20] , will be used for determining lower bounds for TBO, TT, and 
TBIO. This p r o gra m constructs the CM3 from the specified AMS to 
determine TBOj_g. Two examples are presented to illustrate the 
transformation of an AMS through the use of oontrol places and dummy 
transitions. 

Example. Consider the algorithm narked graph of Figure 2.2. The 
corresponding CMS is shown in Figure 2.4. A transformed AMS and 
corresponding CMS are shown in Figures 3.1 and 3.2 respectively. A 
dunrniy transition of zero time is used as buffer between transition 1 
and 6. The AMS's of Figures 2.2 and 3.1 are equivalent as they 
produce the same output sequence for identical input sequences. The 
dumny transition provides an additional storage space for the output 
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Figure 3.1. Transformed algorithm marl 
in Application 1. 
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Figure 3.2. Computational marked graph for the transformed AMG. 
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of transition 1, which is to be used as an input of transition 6. 
Without this dunry transition, transition 1 can fire only once before 
transition 6 fires; however, with the dunry transition, transition 1 
can fire again before transition 6 fires. Application of this 

transformation will be described later. 

An example of transformation by control places is shewn in 
Figures 3.3 and 3.5. Control places delay firing of selective 
transitions aid therefore modify REST and U<E. The dunny transition 
is used again as a buffer, ttprovanent due to this transformation 
will be described later. 


3.2 Performance Improvements by Transformation 

Applications of dummy transitions and control places for 
improving time performance and reduction of resource requirements are 
discussed in this section. New results are stated in Application 1 
and 2 . Application 1 describes how dunry transitions can reduce 
TBOjjj of an AMS to the largest time/token among the process and 
recursion circuits. Application 2 describes how the REST of an AMS 
can be modified to give a lower peak IRE through the use of control 

places. 

imi i cation 1 . This is an application where a dunry transition is 
used as a buffer. A dunry transition can provide storage space for 
the output of a transition. This can increase the firing rate of 
transitions as AIAMd does not allow firing of an active transition 
unless its outputs are read by successor transitions. In terms of the 
CMS, a dunry transition can increase the number of tokens in the 
circuits of an CMS created by parallel paths in the AMS. This is the 


basis for Theorem 3.1. 



Theorem 3.1: Reduction of TBO^ to the Largest Time P er Token Among 
the Process and Recursion Circuits by tXnnmy Transition . Any AMS can 
be transformed by using dumny transitions as buffers so that 


TBO^ = Max mqj/MfCi) } (3.2.1) 

where T(Cj_) and M(C^) denote the sum of transition times and the 
number of tokens contained in of the CMS respectively. Circuit 
C^ is a process or recursion circuit. 

Proof. There are four kinds of circuits in a CMS, as mentioned in 
Section 2.2. They are node circuits, process circuits, recursion 
circuits, and parallel path circuits. Theorem 2.3 has proved equation 
(3.2.1) when C^ is any directed circuit of the CMS. From ATWW 
model characteristics, as described in the Appendix, both node and 
process circuits always have only one token. Also the sum of 
transition times for process circuits are always greater than, or 
equal to, that of their corresponding node circuits as process 
circuits include the successor read transition. Consequently, the 
largest time/ token ratio of process circuits is always greater than, 
or equal to, the largest time/ token ratio of node circuits. The 
remaining task is to show that the time/taken ratio for circuits in a 
CMS due to parallel paths in the AMS can be reduced sufficiently to 
make them insignificant in determining TBOj- r . Consider any two 
parallel paths Pj_ and Pj of the AMS which begin and end at 
transitions S and E respectively. Consider the parallel path circuit 
in the CMS created by forward directed places (for data flow) from NMG 
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transitions of path Pi and backward directed places (for control 
flow) front NIC's of path Pj. Each of these backward directed places 
has a token in the initial marking. The number of such backward 
directed places are one more than the number of transitions on path 
Pj, excluding transitions S and E. Inserting a durnny transition of 
zero time on path Pj will increase the number of tokens in this 
circuit by one. As this dunny transition does not have any time, it 
cannot increase the T(C A ) of this circuit or any other. Hence, the 
time/token ratio of this circuit will decrease while not increasing 
the time/token ratio of any other cirooit. By inserting more duimy 
transitions on path Pj, the time/token ratio for this circuit can be 
arbitrarily reduced. If the time/token ratio for this circuit is 
greater than the largest time/token ratio from process or recursion 
circuits, dummy transitions can be used to reduce the time/token ratio 
to a value lower than, or equal to, the largest time/token ratio among 
process or recursion circuits without increasing the time/token ratio 
of any other circuit. Following this procedure, sufficient durnny 
transitions may be added so that the time/token ratio for any parallel 
path circuit in the OG is smaller than, or equal to, the largest 
time/token ratio among process or recursion circuits. The procedure 
is guaranteed to terminate as dummy transitions, when used as buffers, 
never increase the time/token ratio of any circuit. This completes 

the proof. 

Exaspie consider again the MC of Figure 2.2. •me corresponding CMC 
is drawn in Figure 2.4 assuming zero time for read and write 
transitions. Therefore, TBO^ is 3. There is no recursion circuit 
in the MG. The largest time/token ratio among all process circuits 
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is 2 and the largest time/token ratio among node circuits is 2 . 

However, the largest time/token ratio among all directed circuits is 3 
due to two parallel path circuits as shewn in Figure 2.4. For both of 
these circuits, parallel paths in the AMS start and end in transitions 
1 and 5 respectively. Let denote transition i and pj denote 
place j. Path Pj for both circuits is the forward path t 1 , p 6 , 
t 6 , p 8 , and t 5 . Path for the two parallel path circuits are t 1# p 2 , 
t 2 , P 3 , t 3 , p 4 , t 4 , p 5 , and t 5 , and t 3 , p 2 , t 2 , P7, t 7 , P 9 , t 4 , p 5 , 
and t 5 respectively. Both of these circuits have two tokens from 
backward directed places fron the NM3 transitions of path Pj, as 
shown in the CM3. Now the AMS is transformed by inserting a dummy 
transition on path Pj as shewn in Figure 3.1. The corresponding CMS 
is shown in Figure 3.2. The number of tokens on the parallel circuits 
are now 3 and therefore the time/token ratio is 2. Time/token ratio 
for any other circuit does not increase as the dumny transition has 
zero time. The largest time/token ratio over all directed circuits is 
now 2. However, TBOj- r for the AMS of Figure 3.1 is 2, and 
transformation by a dumny transition has improved throughput 
performance. 

& p p] jrai-inn 2 . This is an application to demonstrate a procedure for 
reducing resource requirements. Control pla ce s and dumny transitions 
are the two transformation tec h nig ue s which are used. Suppose that 
all the data sets of an AMS require resource envelope, as given by 
REST, and data sets are injected at the interval of TBO time units. 

The total resource envelope will then be given by THE and the peak 
value of IRE will be the required number of functional units. Fran 
Chapter Two, IRE is periodic and one period of TRE is made by 



additions of sections of REST of width TBO. This immediately leads to 
the possibility that the peak value of TOE might be lowered by 
adjusting the shape of REST if the peak value of TOE is more than the 
nd ninum requirement fTCE/TBOl . REST can be modified by 
delaying active transitions selectively with the help of control 
places. This may or may not lead to an increase in TT^ (thereby 
duration of REST) or TBIO^ depending on the "float" of delayed 
active transitions. Float is the amount of time an active transition 
can be delayed without increasing TBIO^g and TTj^. 

A desired result is to modify REST without increasing TBIO^ 
ard TTjjj to achieve TBO^ with a minimum number of resources. 
Unfortunately, this problem is equivalent to a class of scheduling 
problems which is known to be NP complete [12]. Thus, REST rust be 
modified heuristically by control places. Judicious insertion of 
control places may reduce the resource requirement for the same 
TBOjjj, but perhaps at the expense of TBIOj^. A control place is 
useful if it can reduce resource requirements by delaying transitions 
with float or by sacrificing parallel concurrency to sane extent. 
Lastly, insertion of control places in the MG can create dominant 
parallel path circuits in the corresponding CSC which are made 
insignificant following the procedure of Application 1. 

The methodology for lowering the resource requirement is now 
stated. First, construct REST and TOE for the MG at specified TBO. 
The peak value of TOE is the resource requirement for an input data 
injection interval of TBO. If the peak value of TOE is more than 
[TCE/TBO] , heuristically modify REST by transforming 
the MG with control places with as small an increase in TBIO^j and 
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TTj^ as possible. Make all dominant parallel path circuits created 
by control places insignificant by adding dunny transitions. An 
exanple is given below to illustrate Application 2. 

Example. Consider the algorithm marked graph of Figure 3.3. Fran the 
AMS, ICE = 12, TBOj_g = 2, and TBIO^ = TT^ = 6. The minimum 
resources to achieve TBO^ are [TCE / TBO LB ] = 6. REST is shown 
in Figure 3.4. Adding sections of REST of width TBO^, a period of 
TOE is computed arri is shown in Figure 3.4. The peak value of TRE is 
9 . Henoe, nine functional units are required for implementing this 
AMG for optimum time performance. As the minimum resource required 
for TBOjjj is 6, Application 2 is considered. The AMG is transformed 
heuristically, as shown in Figure 3.5. The dotted lines are control 
places 1 through 4. Ignore control places 2 , 3, and 4 initially. The 
justification of control place 1 is as follows. It is noted that 
transition 5 is the only transition which has a float in the AMG. 
Transition 5 can be delayed up to two time units without delaying the 
output. Considering section 1 of REST as shown in Figure 3.4, 
transition 5 should be delayed one time unit so that the peak value of 
TOE is reduced to 8. This is accomplished by control place 1. The 
modified REST and TRE are shown in Figure 3.6. unfortunately, control 
place 1 creates a parallel path circuit among transitions 1, 4, and 5 
whose time/token ratio is more than 2. The time/token ratio of this 
circuit is made less than 2 by inserting a dummy transition on the 
place between transition 1 and 5. Now consider section 2 of REST as 
shown in Figure 3.6. It contributes (4, 1) to a period of TRE. In 
order to reduce the peak value of TRE, a more equal distribution of 

the time intervals (t, t+1) and (t+1, t+2) of TRE 


transitions among 







Figure 3.5. Transformed AMG for Figure 3.3. 
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is needed. Control places 2 , 3 , and 4 do this job at the expense of 
increasing TBIO^ and TTj_g by one time unit. The REST and TRE of 
the fully transformed AMS of Figure 3.5 are shown in Figure 3.7. New 
only six functional units are required, which is the mininura for a 
TBOj^ of 2. It is to be noted that the maximum utilization of 
resources may not be achievable by use of control places in all cases 
unless the AMS is turned into a complete chain. 


3.3 implementation Of Periodicity By Transformation 

This sec t ion describes a procedure for enforcing periodicity in 
the execution of an algorithm marked graph for successive data sets. 

It is des ired that performance and resource needs be identical for all 
data sets for two reasons. First, input data should not experience a 
waiting time on the critical path of a task so that TBIO^g is 
achieved for all data sets. Second, the resource envelopes for all 
data sets should be identical so that the total resource need can be 
predicted. It will be shown in Application 3 and 4 of this section 
that by controlling input data injection and transforming the AMS by 
dummy transitions, periodicity can be realized in the execution of the 
AMS. The need and methodology for injection control of input data is 
explained in Application 3. Application 4 describes the conditions 
for operating an AMS periodically with each data packet having 
identical resource envelopes. 

& jy>i -i oat inn 3 . When presented with continuously available input data 
sets, the natural behavior of a data flew architecture results in 
operation where new data sets are accepted as rapidly as the available 
resources and the input transition of the AMS permits. From Chapter 





74 


Two, the output of the AMS cannot be generated at a higher rate than 
I/TBOjjj or F/TCE. Therefore, if the data sets are continuously 
available, they experience a waiting tine inside the architecture 
which increases TBIO from TBIOj^. That is, the architecture will 
naturally operate at high levels of pipeline concurrency with the 
possible loss of capability for achieving high levels of parallel 
concurrency. This will result in performance characterized by high 
throughput rates,' but relatively poor task ocnputing speed. In many 
control and signal processing applications, it is important to achieve 
both a high throughput rate and high task ocnputing speeds. 

Therefore, it is necessary to control injection rate of data sets so 
that input data never waits on the critical path. The input data 
injection interval must always be greater than, or equal to, TBO^ 
and it should be such that all task inputs always have a resource 
available to fire transitions on the critical path to the data output 
sink. This can be accomplished by either adjusting the tune for the 
source transition or as shewn in Figure 3.8. It is not always easy to 
adjust the source transition time as this will be the saupling 
interval of sensors in a real system. All that is required is to 
limit the rate at which new input data are presented to the CM3. This 
is done in Figure 3.8 by adding a dunmy transition in a directed 
circuit with the data input source. The predefined token on the 
directed circuit is for initialization. The durnny transition imposes 
a minim u m delay of D time units between inputs. D is chosen to be the 
designer specified TBO. 

Application 4 . It is necessary that all data sets have the same 

that the total resource requirement can be 


resource envelope so 
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of time D 

Figure 3.8. Injection control by Application 3. 
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predicted. Also at steady state, it is desirable that all data sets 
require resource envelopes identical to REST as REST can be modified 
to lower the peak value of IKE as described in Application 2. In 
order to achieve such a resource envelope, all transitions of the AMG 
should fire as soon as there is a token on every input place. The 
first step is to control the data injection interval as discussed in 
Application 3. If this condition is satisfied, then it can be 
guaranteed that a data token never waits on the critical path fran the 
data input source to the data output sink for all data sets. Hence, 
TBIOlb is achieved for all data sets. Secondly, the resource 
envelope for a data set of an AMS at steady state may not be identical 
to the PEST even though injection is controlled for the following 
reason. Whenever there are parallel paths in the algorithm marked 
graph, the transitions on non-critical paths of the algorithm marked 
graph will have a float associated with than. The float of a 
transition is the time by which a transition can be delayed without 

increasing TBIO^ and TT^. if there is not enough storage space 

for previous data, transitions in the AMS with float may not fire even 
though all the input places have token. The reason is that one or 
nore output places of the transition contain previous data. This will 
change the steady state resource envelope from the PEST. One way to 
prevent this fran happening is to use control places to eliminate all 
floats fran the AMS. However, this may not be always possible as any 
control place has to be generated fran the completion of execution for 
a transition. Also, use of control places may require dumny 
transitions to prevent TBO^ fran increasing, which will make the 
AMS more coiplex. A better way of enforcing REST for all data sets 
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is to use duinny transitions as buffers in the output of transitions 
with float which need more storage space for previous data. The 
position and number of dummy transitions can be determined from TGP 
based on GPST. As the input injection interval is greater than, or 
equal to, TBO^, PEST should be enforced for the injection interval 
of TBOjjj. This will also guarantee REST for all data sets with any 

higher injection interval. The reason is that transitions are 

executed at a lower rate for a higher injection interval and need for 
storage space at the output of floating transitions will be lower. 

The de tail ed procedure is new stated belcw. 

Construct the TGP based on REST for TBO - TBO^. locate all 
transitions with float and identify their corresponding task input 
number. By inspection of TGP, check whether all the successors of a 
floating transition for the previous task inputs have fired before the 
floating transition fires. If not, the floating transition needs 
dummy transitions as buffers at its output. The number of required 
dummy transitions equals the number of previous task inputs for which 
at least one of the successor transition has not fired at the time of 
firing of the floating transition. 

Example. Consider the algorithm marked graph of Figure 3.9. From the 
AMS, TBOlb = 2 and TBI0JJ3 = TTjjj = 5. Only transition 5 has a 
float of two time units. GPST and TGP for TBO * TBOj^ = 2 are shown 
in Figure 3.10. Task input 1 has started TBO^ before task input 0, 
and task input 2 has started another TBO^ before task input 1. The 
successor of floating transition 5 is transition 4. Another 
predecessor of transition 4 is transition 3. Notice frtxn the TGP that 
4 (2) ^ started before 5<°>; 3< x > begins with 5<°>. As 4* 1 * is 




Figure 3.9. Example AMG for illustration of 
Application 4. 
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Figure 3.10. (a) GPST. (b) TGP for TBO-2. 
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executed after 3 (1) in the GPST, 4< 1) has not started before 
5 (°) . Hence, me dummy transition is n eeded at the output of 
transition 5 to store 4^ so that 5<°> can fire according to the 
GPST. Otherwise, the firing of 5<°> will be delayed as the NMO 
nodel of a transition does not allow the firing of a transition unless 
the output buffer is empty. The transformed AMS is shown in Figure 
3.11(a) . The TCP for TBO = 3 is shewn in Figure 3.11(b) . Transition 
5 no longer needs a dummy transition in the output for enforcing 
REST. Hence, the transformed AMS of Figure 3.11(a) enforces REST for 
TBO eq ual to both 2 and 3. 


3.4 structural Changes In Algorithm by Transformation 

The trans formations considered so far try to preserve the 
original structure of an algorithm marked graph. In certain 
conditions that may not be possible, or desirable. For example, it is 
possible to inprove TBOj^ of linear time invariant systems by 
modifying the state equations. In this section, three kinds of 
structural changes of algorithms are considered in Application 5 
through 7. Application 5 explains hew multiple input-output 
algorithms or a group of algorithms can be combined into a single 
input-output algorithm. This is necessa r y because the analysis tools 
developed in this dissertation are based on single input-output 
algorithms . Improvement of throughput by modifying the state 
equations of linear time-invariant systems is demonstrated in 
Application 6. Application 7 considers the parallel decomposition of 
transitions as a way of improving performance. 
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^iretion 5 . The performance model of Chapter TVro considers only 
single input and single output algorithms. The addition of dunuy 
transitions provides a way of converting irultiple input-output 
algorithms or a nuntoer of algorithm into one single input^utput 
algorithm. A dummy transition is used to ocntoine input data vectors 
or output data vectors. All the inputs are synchronized and fed to 

the dummy transition at the same rate. Performance is evaluated from 

the combined algorithm which represents the total task. Tvo examples 
are shown in Figures 3.12 and 3.13. In Figure 3.12, MG A x has two 
inputs and two outputs. It is transformed into a single input-output 
algorithm A 2 by duntay transitions. Figure 3.13 shews how dunmy 
transitions can be used to ocntoine two algorithms into one algorithm. 

cation 6 . This is an application of increasing throughput of 
linear tine invariant systems by increasing the number of tokens in 
the circuit. Linear time invariant systems are described by the state 

equations as stated belcw. 


x(k) = Ax(k-l) + Bu(k) 

y(k) - Cx(k) + IXi(k) (3.4.1) 

where x is the state vector, y is the output vector, and u is the 
input vector. A, B, C, and D are tine-invariant system matrices. The 
corresponding algorithm marked graph is shown in Figure 3.14. 

Usually, Ax(k-l) is the most tine consuming computation in the MG. 

In such a system, the recursion circuit determines the TBO^. It is 
shown that it is possible to reduce the time/token ratio of this 
recursion circuit by doubling the number of tokens so that TBO^ is 
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Figure 3.12. (o) AMG A,, (b) Transformed 

AMG A 2 . 
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Figure 3.13. (o) Algorithm 1. (b) Algorithm 2. (c) Algorithms 
1 and 2 are combined by dummy transitions. 
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Figure 3.14. AMG for the linea 
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improved to the largest time/token ratio of the process circuits in 
the CM3. This is useful if decomposition is not desirable and TBO^ 
needs to be reduced approximately to the largest transition time of 
the AMS. The methodology for reducing the time/token ratio of the 
recursion circuit is expressed below by the statement and proof of 
Theorem 3.2 with the assumption that Ax(k-l) is the largest transition 
in the AMS representing the state equation. 

Theorem 3.2 . It is possible to inprove TBO^ to the largest 
time/token ratio of the process circuits of a linear time invariant 
system by reducing the time/token ratio of the recursion circuit by 
doubling the number of tokens in the recursion circuit. 

Proof. Theorem is proved by construction. A ss umin g Ax (k 1) 
(transition 4 ) to be the largest transition of Figure 3.14, TBO^ is 
determined from the recursion circuit. Application 1 has shewn that 
any AMS can be transformed so that TBO^g is dete rm i n ed by only 
process circuits and recursion circuits. Thus, the statement of 
Theorem 3.2 will be proved if the AMS for the state equation can be 
transformed so that the time/token ratio of the recursion circuit is 
smaller than that of the largest process circuit. let the state 
equation represent a 1-input, m-output, and n-element state vector 
system. The dimensions of A, B, C, and D are then (n, n) , (n, 1) , 

(m, n), and (m, 1) respectively. New 


x(k) = Ax(k-l) + Bi(k) ; 
x(k-l) = Ax(k-2) + Bu(k-l) ; 
x(k) = A{Ax(k-2) + Bu(k-l) } + ai(fc) • 
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It follows from the linearity of the system that 

x(k) = (A * A)x(k-2) + (A * B)u(k-l) + ai(k). 
Let A * A = E and A * B = F. Then, 


x(k) = Ex(k-2) + Fu(k-l) + &i(k) . 


(3.4.2) 


Notice that the dimension of E and A and F and B are the same. 
Therefore, the amount of carputation of Ax(k-l) and Ex(k-2) and 
Fu(k-l) and Bu(k) sire the same. However, if equation (3.4.2) is used 
instead of equation (3.4.1) for representing a linear time-invariant 
system, the recursion circuit has two initial tokens as x(k) is 
generated from x(k-2) . The new AM3 b a sed cn equation (3.4.2) , and the 
original output equation, is shewn in Figure 3.15. The dunmy 
transitions are inserted to act as buffers so that transitions are not 
blocked from firing because output buffers are never enpty. T 1# 

T 2 , and T 3 are predefined tokens. = F * u(k-l) , T 2 = E * x(k-2) , 
and T 3 = x(k-l) . Let k = 1, 2, 3. .. and the initial state vector be 
x(0) . Therefore, the first input and output are u(l) and y(l) 
respectively. That is, u(s) = 0 for s equal to zero or negative. 
Therefore, the initial values of T^, T 2 , and T 3 correspond to k 
= l. Hence, the initial values of T^ and T 3 are T^ = F * u(0) = 

0 and T 3 = x(0). From (3.4.2), 


T 2 = Ex(k-2) = x(k) - Fu(k-l) - Bu(k) . 
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Therefore, the initial value of T 2 is given by x(l) - JU(O) - 
Bu(l) . As u(0) = 0, the initial value of T 2 = x(l) - &i(l) • Hence, 
it follows from the equation (3.4.1) that the initial value of T 2 = 
Ax(0) + Bu(l) - Bu(l) = Ax(0). Therefore, all the initial values of 
the predefined tokens can be calculated from the initial state 
vector. The recursion circuit new consists of transitions 2 and 4 and 
there are two tokens in that circuit. The ocoputation level of 
transition 4 has hot changed, although that of transition 2 has 
doubled. Thus, the new time/token ratio of the recursion circuit is 
T(4)/2 + T(2) , Where T(4) and T(2) are the times for transition 4 and 
2 of the original algorithm marked graph. Assuming T(4) is much 
greater than T(2) , the TBO^ of the new algorithm marked graph of 
Figure 3.15 is given by the process circuit of transition 4 whose 
time/token ratio is the same as in Figure 3.14. 

Application 7 . This application establishes a method for finding the 
raximum level of parallel decomposition of a transition in an AMS for 
the best confuting speed of the transition. Decomposition reduces 
process times of transitions; unfortunately, it also increases the 
cotmunication cost due to an increase in number of transitions and 
places in the graph. Therefore, ccrputing speed is improved with 
deceptions up to a certain level. For the lowest process time, 
transitions are decomposed uniformly. The maximum level of 
decomposition of the transition is determined fran the condition for 
the fastest ccrpletion of the confutation represented by the original 

transition. 

Let T be the confutation time of a transition which can be 
fec aspoeed in parallel arbitrarily without changing T. Let this 
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transition be deocrposed into N equal parallel transitions as shown in 
Figure 3.16. Each T A is T/N. The time to complete the total 
amputation (A) f or T in the worst case is then given by 


A = R + T/N + C 0 + W. 


(3.4.3) 


R aid W are the read and write tiroes to carpi**. raadin, and wrltinj 
of data for all Tf transitions, when this set of N transitions is 
cceputinj T, sane other transitions of the AMG may be concurrently 
processed. c 0 is the tine required by each functioal unit to 
receive data free, the transitions of the rest of the HC during the 
co^utinj of T. Cq is assured to be independent of N and i. Any 
data are assured to be broadcast to all functional units by a 
transmission medium. It is assumed that one data packet can be 
broadcasts! at a time to all functional units. It is also assumed 
that total transmission time for output data for all N transitions 
to gether does r»t chaige with H. The worst case value of read and 
write time for all N transitions together can then be expressed by the 

following equation: 


r + W = + N*L*C2 + Cj, 


(3.4.4) 


where is the time that the transmission medium has to be used to 
serve the rest of the MG during the read and write operations for N 
transitions of T. q is assumed to be independent of N. Cj is 
the average access time for the transmission medium and L is the 

functional unit has to access the transmission 


number of times a 
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<b) 

Figure 3.16. (a) An AMG with a large transition T. 

(b) T ia decomposed in N parallel 
transitions. 
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medium for confuting a transition. C 3 is the time to transmit 
output data over the transmission medium for all N transitions 
together and is assumed to be independent of N. Therefore, from 3.4.3 

and 3.4.4, 


A = T/N + C Q + C x + N*L*C 2 + C 3 . 
For minimizing A, dA/dN = d 2 A/dN 2 = positive. New 


dA/dN = (- T/N 2 ) + (L*^) 
d 2 A/dN 2 = 2 * (T/N 3 ) . 

As T and N are always positive, d 2 A/dN 2 is positive. Equating 
dA/dN = 0, 


0 = (- T/N 2 ) + (L*^) ,* 
N • [{T / (L*^)}* 5 ] 


As N has to be an integer and higher N will mean higher ocrnunicatian 
cost, 


n * Lu T / ( l * c 2> 

Also as N > 2 for any decomposition, 


T > 4 * L * C^. 


(3.4.6) 
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Thus knowing Cj, which is an architecture dependent parameter, the 
minimum value of T for decomposition can be evaluated from (3.4.6) . 
Equation (3.4.5) provides the maximum level of deccnposition. 

Example. Let T be the processing time for transition B in an AM3 as 
shown in Figure 3.17. Suppose B can be arbitrarily deocnposed in 
parallel. Let T = 10, C 2 = 0.25 and L = 2. As T > (4*2*. 25 = 2) , B 
can be deocnposed to improve performance. let B be deocnposed in N 
transitions in parallel. Hence, N > [[ { 10/ (2*. 25)} ]J = 4. 

In order to maintain process time for ccnputation T reasonably higher 
than ccninunication time for large granularity, a level of 
deccnposition, less than or equal to, half the maxi nun level is 
ggfflimpri to be appropriate in the following exanple. Thus N is chosen 
to be 2. The deocnposed transition B is shewn in Figure 3.17. 

3.5 Summary 

Applications of algorithm transformation are discussed in this 
chapter and transformation techniques are defined. Improvements of 
TB0j_g are achieved by dumny transitions. Resource requirements may 
be lowered by con t rol places and dummy transitions. Irput data 
injection is controlled by predefined token and dummy transition. 
Periodicity in the resource envelope is enforced by dummy 
transitions. The methodology for transforming algorithms into single 
input-output algorithm is described. The TBO^j of linear 
time-invariant systems is improved by predefined tokens. lastly, 
parallel deccnposition of transitions are considered to illustrate the 
trade-off between decreased granularity and increased ocrarunication 


cost. 
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Figure 3.17. (a) AMG before decompoeition of B. 

(b) B is decomposed. 



CHAPTER POUR 


AIWM OPERATING POINT design 

4 . o Introduction 

The AIAMM operating point (AOP) describes the specification of 
the input data injection interval (latency) , resource requirements and 
the time performance of an algorithm marked graph operated on an AIAM4 
data flow architecture. The design of operating points based on the 
number of resources of the AIAIM data flew architecture is 
investigated in this chapter. The methodology is demonstrated through 
examples, simulations, and experiments. Properties of the ATWM 
operating point under the allowable transformations and implementation 
strategies are discussed in Section 4.1. In Section 4.2, AOP design 
methodology is developed. Performance model, transformation 
techniques and the AOP design methodology are verified by simulations 
and experiments on test algorithms in Section 4.3. A summary of the 
chapter is presented in Section 4.4. 


4.1 Characteristics of Operating Point 

The ATAM4 operating point is the parameter set (TBI, R, TBIO, IT, 
and TBO) for an algorithm execution where TBI is the input data 
injection interval (latency) and R is the minimum number of resources 
required by the AIAMM data flow architecture. The design problem is 
to specify an operating point for executing an AMG in the A1WM data 
flow architecture which achieves optimum time performance with a 


95 



96 


mi nimum nunter of computing resources. Unfortunately, this problem is 
equivalent to a class of scheduling problems which is known to be NP 
oorplete [12] . Thus, there exists no methodology for obtaining an 
aptirum solution which is better than enumerating all possible 
solutions and then choosing the best one. However, it is possible to 
develop a procedure for generating sub-cptimal solutions. This is the 
objective of this chapter. The design objective is to determine an 
operating point given the number of resources, and to provide the 
guidelines for generating a new operating point should the nunber of 
resources change. Also, the expected time performance for TBIO and TT 
should remain the same with any input data injection interval greater 
than that of the operating point as long as the nunber of resources 
are not decreased. The following properties are assumed in the 
operating point design: 

a) input data from the source are injected into the AIMM data 
flow architecture at a constant rate, and hence the time 
between s uccess ive inputs (TBI) is always the same. 

b) For all input data of the task, TBIO * TBIO^ and TT = 

TT; ib* 

c) Each data set requires a resource usage envelope identical to 
PEST. 

All of these properties are realized by the use of Applications 3 
and 4 of Section 3.3. These properties are needed for achieving the 
best task ccrputing speed for all task inputs and to accurately 
predict resource requirements. As stated in Application 3, the time 
between successive data inputs (TBI) is adjusted to be greater than, 

that input data never wait on the critical 


or equal to, TBOj^ so 
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path to the data output sink. The algorithm marked graph is 
transformed as in Application 4 so that the resource envelope for each 
task input is REST. Hie design procedure mist determine the allowable 
rarge of TBI so that the AXNM data flow architecture has sufficient 
resources to meet the resource requirements of all task inputs. 1st 
be the peak value of REST. Therefore, any task input requires 
at least R^ resources to meet properties b and c. 1st R^ be 
the largest peak value of TRE for any TBI > TBOj^. Hence, with 

or more functional units, any ATAIM data flow architecture can 
execute the AMG while achieving TT^ and TBIO^ for any injection 
interval greater than, or equal to, TBO^. It is to be noted that 
TBI and TBO are the same for any AMG at steady state. Finally, let 
the number of resources of the AIAM1 data flow architecture be denoted 

fcy R. 

The operating point for various numbers of resources can be 
displayed on a graph of TBO versus TT. Every point in the graph is 
associated with a value of TBIO and R. Fran Chapter Two, TT > TCE/R 
and TBO > TCE/R. Also TBI and, hence, TBO need not be increased 
beyoni TTasR^-R^ontheTBO-TTline. Therefore, the AOP 
is expected to lie in a triangular area of the graph determined by the 
number of functional units of the ATAM* data flow architecture. The 
characteristics of the operating point are shown in Figure 4.1. 

Let the problem be specified by an algorithm marked graph. Let 
the best possible performance under the rules of operating point 
design be defined as the absolute lower bounds for the time 
performance. Formal definitions of the absolute lower bounds for TT, 

TBIO, and TBO are new stated. 
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Figure 4.1. ATAMM operating point characterietica. 
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ration 4.1; Absolut e Tower Bound for 3BIQ- ^ absolute lcwer 
bourd for TBIO (TBIO^g) is defined to be the lowest TBIO^ for 
the algorithm marked graph with or without any transformations. 
ne>f inition 4-2: Absolute IfflBE fr M& tSL TT* The absolute lower 

bound for TT (TT^g) is defined to be the lowest TTjg for the 
algorithm narked graph with or without any transformations. 

Definition 4.3: A^lute lower Bound fo r XBQ. Hie absolute lower 

bound for TBO (TBO^) is defined to be the lowest TBC^ with or 
without any transformations. 

Let the transformation be restricted such that only dummy 
transitions (of zero time) and control places (with no initial token) 
are used for transforming the algorithm marked graph* Theorems are 
now described to determine the absolute lower bounds under the above 
transformations . 

Thporem 4.1 . The absolute lower bound for TBIO is equal to the lower 
bound without any transformations. 

Proof. Control places can create new paths in an algorithm marked 
graph but do not alter existing paths in the AMG. Danny transitions 
of zero time increase the number of transitions on a path in the AMG 
but do not increase the path length. Therefore, any path in the 
original AMG is also a path in the transformed AMG with equal path 
length. The critical path from the data input scuroe to the data 
output sink in the MAMG of the original algorithm marked graph is also 
a path from the data input scuroe to the data output sink in the MAMG 
of the transformed AMG. Hence, TBIO^ of any transformed AMG under 
the stated transformations cannot be lower than that of the original 
one. Therefore, the TBIO^ of an algorithm marked graph is 
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determined by the IBIO^ of the HC without any transformations. 

This completes the proof. 

■menrem 4.2 . The absolute l<*er bound for TT is equal to the lower 
bound without any transformations. 

Proof. The proof is similar to that of Theorem 4.1. However, TT^ 
is determined by the critical path among all paths frm the data input 
source to any output sink in the MAMS. By the arguments of Theorem 
4.1, this critical path in the MMG of the original MG is also 
present with equal path length in the MMG of the transformed MG. 

Thus, TTlb cannot be reduced by transformation with dunny 
transitions (zero time) and control places (no initial token) . Hence 
the TT^b of an MG is determined by the TT^ of the MG without 
any transformations. This completes the proof. 

Thggiem 4.3 . The absolute lcwer bound for TBO is equal to the largest 
time/token ratio among the process and recursion circuits in the OG 
of the original algorithm marked graph without any transformations. 
Proof. Theorem 3.1 has proved that the TBO^ of an algorithm marked 
graph can be reduced to the largest time/token ratio of the process 
and recursion circuits by transforming with dunny transitions of zero 
time. Because of the way process and recursion circuits are created, 
dummy transitions do not alter their time/token ratio. Control 
places, on the other hand, can create new parallel path circuits in 
the OG but do not change the time/token ratio value of the circuits 
in the QG of the original MG. Therefore, the lowest TBO^ and 
TBOam is determined by the largest time/token ratio among the 
process and recursion circuits in the OG of the original MG. This 

ccnpletes the proof. 
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Any operating point will have TBIO, IT, and TBO values greater 

than, or equal to, those specified by the respective absolute lower 

bounds. Figure 4.2(a) displays the characteristics of the operating 

point when designed with only dummy transitions (zero tune) and 

control places (no initial token) . Any operating point resides in the 

area BVWH. The point B corresponds to the operating point which 

achieves the absolute lower bounds for TBIO, TT, and TBO. Lines BV 

and EH represent operating points which achieve the absolute lcwer 

bounds in task computing speeds (TT and TBIO) and the output interval 

(TBO) respectively. With the specified transformations, TT^ cannot 

be more than TC. Any operating point on line HW has TT^ = TC, 

which indicates the absence of any parallel concurrency. Point W is 

characterized by TT^ = TBO^ = TC and represents ocnplete 

sequential operation with no concurrency. A3MM is most appropriate 

for problems which require both vertical and horizontal concurrency. 

It is assumed that TBIO^ and TT m are achieved for any TBI 

greater than, or equal to, the data injection interval at the 

operating point. Therefore, the minimum resource requirement at any 

operating point is the greatest peak value of TEE for any TBI > 

TBO , where TBO_. is the data output interval and the input data 
op 

injection interval at the operating point. 


4.2 Operating Point Design 

Let the problem be specified by an algorithm marked graph for 
which the ATAM4 operating point is to be dete rm i n ed. The only 
allowable algorithm transformations are dummy transitions of zero time 
and control places. Predefined tokens and decomposition will not be 
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Figure 4.2(a). AOP characteristics under specific 

transformations. 
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considered for operating point design. The AOP design consists of six 
steps. These steps are described in the remainder of this section. 

The opera ting points are determined corresponding to different number 
of resources for the algorithm marked graph of Figure 3.3 to 
illustrate each step as it is presented. 

Step i . construct the CM3 from the AMS. Determine lower bounds and 
absolute lower bounds for TBIO, IT, and TBO for the AMS. If TBOj^ 
is greater than TBO^, transform the AMS with dummy transitions to 
achieve TBO^, as in Application 1 of Section 3.2. Determine 
and R^. If Fnax > |TCE/TBO alb | , heuristically transform 
the AMS with control places and dummy transitions to reduce 
without increasing TBIO^, TT^, and TBO^, as in Application 2 of 
Section 3.2. Determine new R^y and R^n values. lower bounds of 
performance for the resultant AMG are also the absolute lower bounds 
for TT, TBIO, and TBO under the specified transformations. 

From the AMS of Figure 3.3, TBIO^ = 6, TT^ = 6, TBOj^g = 2. 

Also TBIO^ = 6, TT^lb = 6, and TBO^ = 2. REST and TRE 
corresponding to TBO = 2 are shown in Figure 3.4. Checking all TBI > 
2 > Rjnax ■ 9* The AMS of Figure 3.3 is new transformed heuristically 
to lower Rj^ without increasing TBIOj^, TT^, and TBO^, as 
described in Application 2 of Section 3.2. The transformed AMS is 
shown in Figure 3.5 (ignore control places 2, 3, and 4) . REST and TRE 
corresponding to TBI * TBO^ = 2 are shown in Figure 3.6 for the 
resultant AMS. By checking all TBI > 2, it is determined that V 

= 8 ' R min = 4 * 
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step 2 . Choose a convenient transition firing rule. A rule to 
determine when an enabled transition in the CMG fires most be 
specified in the graph manager. The rule usually used is that enabled 
transitions fire when confuting resources are available. If 
contention exists, such as when there are more enabled transitions 
than ccnputing resources, firing occurs according to a priority 
ordering of the transitions. For the algorithm marked graph of Figure 
3.5, the highest to lowest priority ordering of the transitions is 
Chosen as (11, 10, 9, 7, 8, 5, 6, 4, 3, 2, 12, and 1) . 

Step 3 . If R > Fmax functional units are available, operate at TBI 
= TBOjjjj. Use Application 3 and 4 of Section 3.3 to adjust TBI to 
Tbo^jjj and to transform the AMS by dummy transitions in order to 
realize REST as the resource envelope for all task inputs. Eliminate 
all un necessar y dummy transitions. The operating point time 
performance is the absolute lower bound values for TBIO, TT, and TBO. 
The AMG can also be operated for any TBI > TBO^ while maintaining 
TBIO and TT at absolute lower bound values. When R < ^max' 
determine the operating point from one of the following strategies: 
Strategy A: Strategy A is applicable when Rj,^ > R > ^min* 

Preserve TBIO and TT at their respective absolute 
lower bounds at the expense of increasing TBI and 
TBO above TBO atr . 

Stra teg y B is applicable for the following range of 
R. > R * ITCE/TBO alb | . Preserve TBO 

to its absolute lower bound at the expense of 
increasing one, or both, of TBIOm ar *^ 


Strategy B: 
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Strategy C: Strategy C is applicable when Vx > R - 1 * ^ 

operating point is determined by first following 

Strategy B so that R^y > R ^ ^min' ar * i ** ien 
increasing TBI above TBO^. The strategy tries 
to minimize performance degradation in TBIO, IT, and 
TBO from their respective absolute lower bound 
values. 

These three strategies of the AOP design under resource 
oonstraints ere illustrated in Figure 4.2(b) . Strategy A maintains TT 
am TBIO at their respective absolute lowr bound values end reduces 
pipeline concurrency to lower resource retirements. Strategy B 
reduces resource requirements by decreasing parallel oonrerrency 
resulting in a higher lower bourns for one or both of TBIO and TT. 
Strategy C sacrifices both pipeline and parallel concurrency to sore 

extent for lowering resource requirements. 

If the MMM data flow architecture has eight or more functional 

units, the algorithm marked graph of Figure 3.5 can be operated at 
TBIO = TT * 6 arcl TBO = 2 by adjusting TBI = 2 using Application 3 of 
section 3.3. GPST am TGP corresponding to TBI - 2 are shown in 
Figure 4.3 which suggest that no new dimmy transitions are required to 
enforce BEST am SPOT. Resource utilization over e period TBO is 
given by {TCE/ (R*TB0) } = 12/16 = .75. 

S£ep_4. Execute this step if strategy A is appropriate. Increase TBI 
to TBOqp such that TBO^ is the lowest time interval between 
overlapping REST's for the peak value of TSE to be less than, or equal 
to R, for all TBI > TBO^. TBO^ is guaranteed to lie in the 
range fTCE/Rl < TBO op < TT ALB . Operate at TT = TT ALB , 
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Figure 4.2(b). The atrotegiee for AOP deaign 

under resource constraints. 
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tbio - TBIO^, and TBO * TBI ■ TBOop usijig Applicatim 3 of 
Section 3.3. TBIO^ and TT^ are also achieved for any TBI > 

TB°op- 

Assume, the AIAMM data flew ardiitecture has five functional 
units. As = 4, Strategy A can be applied. Following Strategy 

A, it is found that TBO^ = 3. Overlapping of KEST's for TBI = 3 is 
shown in Figure 4.4(a) . The operating point is given by TT = TBIO = 6 
and TBI = TBO = 3 and FU(TBO) = {12/ (5*3) ) * .8. 

Step 5 . Execute this step if Strategy B is appropriate. 

Heuristically transform the AMG to reduce R^ using control places, 
as in Application 2 of Section 3.2. Maintain TBO^ at TBO^ by 
using dunmy transitions. A good heuristic is to reduce R^ 
significantly. There is a guaranteed solution at TT^ = TC, 

TBIOlb = TTC, and TBOlb - TBO^ by transforming the AMS into a 
complete chain. Eliminate all unnecessary dummy transitions. Operate 
the transformed AMS for TBI = TBQ&tr ~ TBO, TT — TT^j, and TBIO 
TBIO]-r using Applications 3 and 4 of Section 3.3. 

Suppose the ATAM4 data flow architecture has six resources. TCE 
= 12 units of computer time. As R > [TCE/TBO ALB l = 6 ' 

Strategy B can be applied. R^ is reduced to 6 by control places 
2 , 3 , and 4 as shown in Figure 3.5. New REST and TRE for TBI = 2 are 
shown in Figure 3.7. The peak value of TRE is 6. TTj^ * TBIO^ = 

7 . By checking all TBI > 2 for this AMS, it is found that ^ = 6 
and = 3 . GPST and TCP for the transformed AMS are shewn in 

Figure 4.5. Only transition 5 has a float associated with it. The 
successor of transition 5 is transition 11. By inspection of the TCP, 
transition fires before transition 11 (2) , which is inpossible 
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in an ATAhM unless there is a buffer between transitions 5 and 11. 
Hence one durrrny transition is required between transitions 5 and 11 as 
shown in Figure 4.6 to enforce REST as the resource envelope for all 
task inputs. The operating point is given by IT = TBIO = 7 and TBO = 
TBI - 2; RJ (TBO) = 1. 

step 6 . Execute this step if Strategy C is appropriate. Transform 
the AMG by Strategy B until R^ > R > Rmin 31x1 thfin ijicrease TBI 
to determine TBO^, as in Strategy A. 

let R = 4. The AMG is transformed by Strategy B as described in 
step 6. Now R,^ = 6 and IW * 3 ' As R is within the range of 
and R^, the operating point can be determined by increasing 
TBI as in Strategy A. Increasing TBI, TBO^ * 4. Overlapping of 
REST's and IRE for TBI = 4 are shewn in Figure 4.4(b) . The operating 
point is given by IT = TBIO = 7 and TBI = 4. Adjust TBI to 4 for the 
AMG of Figure 4.6 to implement the operating point. FU(TBO) = .75. 

These operating points for the AMG of Figure 3.5 are shown in 
Figure 4.7. Operating point B is the oily operating point which 
achieves the absolute lower bounds for IT, TBIO, and TBO and is 
achieved in Step 3. 0P A , OP B , and 0P C are the operating points 
developed by Strategies A, B, and C respectively. 


4 . 3 Test Results 

The performance model, transformation techniques, and the AIAM1 
operating point design procedures are tested by similatians and 
experiments. Simulations on the test algorithms are done by a 
software simulator developed to simulate the execution of an algorithm 
in the ATAMM environment [21] . The input parameters for the simulator 




Dummy transition 

Figure 4.6. Transformed AMG for Steps 5 and 6. 
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are the algorithm marked grafh Eluding all MC transition times, the 
number of resources, and a priority ordering for the transitions of 
the AMS. The input data injection interval is controlled by adjusting 
the source transition time. The simulator detects and writes all 
events associated with the execution of transitions for each task 
input on a graph diagnostic file. The analyzer is a program developed 
to analyze this grafh diagnostic file [21]. The two features of the 
analyzer used in this dissertation are the node activity display and 
the input/output display. The node activity display shows the 
execution of transitions as a function of time. The input/outpit 
display shows TBI, TBO, and TBIO for each task input and also plots 
these quantities as a function of time. Detailed information about 
the simulator and the analyzer are fcund in [21] . Another useful 
program developed is called Ttime which determines the lower bounds 
for TT, TBIO, and TBO in an algorithm marked graph by constructing the 

CMS and MAMS [20]. 

A tes tbed is developed to run test algorithms in the A3W*1 
environment [20] . The AIAMM data flow architecture consists of, at 
nost, three functional units with a distributed global memory and 
graph manager. Figure 4.8 shows the architecture. Functional units 
are realized by IBM Personal Computer AT's. Functional units 
communicate between each other by a Ethernet camunication bus. In 
addition, another IBM PC AT which implements the source and sink 
transitions of the AMS is connected on the Ethernet bus. This IEM PC 
AT is used to begin and end the execution of the test algorithm and to 
generate a graph diagnostic file recording all events during the 
execution of the AMS. At the present stage, the source transition 
time cannot be adjusted to control the injection rate and this rate is 
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Figure 4.8. The teethed ATAUU data flow 
architecture. 
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always equal to a small write time. Thus, it is not possible to check 
the entire AXMM operatic point design procedure on the testbed. 
However, two experiments are carried art to show the effect of dummy 
transitions in improving TBO^ and the use of control places to 
reduce resource requirements. The analyter is used to determine the 
performance of the test algorithm from the graph diagnostic file. 
Detailed information about the testbed can be found in [20]. 

Five test algorithms are chosen to test the tteign procedure, 
performance model, and transformation techniques on algorithms with a 
wide range of structural characteristics. Execution of all five 
algorithms were simulated but only wo algorithms were actually 
implemented on the testbed, mainly due to the resource limitations and 
i nabil ity to control the input data injection interval. The results 
are stated and analyzed for each of the test algorithm execution in 
the following discussion. 

Test l . The primary objective ofthistestistoshowtheuseofa 

dummy transition as buffer in reducing the time/token ratio of a 
parallel path circuit. Experimental time performance is also compared 
with the theoretical time performance predicted by the performance 
model. The test AMS and a transformed test AMS are shown in Figure 
4.9(a) and (b) respectively. The purpose of the dummy transition is 
to reduce the time/token ratio of the parallel path circuit for the 
parallel paths between transition 1 and 3 in Figure 4.9(a) so that 
TB0j_g is improved to the time/token ratio of the largest process 
circuit. All the transition times are expressed in seconds. Priority 
ordering from highest to lowest in the test AMS and transformed test 
AMS are (3, 2, 1) an! (4, 3, 2, 1) respectively. The dummy 
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transition 

(b) 

Figure 4.9. (a) AMG for Test 1. (b) Troneformed 

AMG for Test 1 . 
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transition is implemented as an active transition of zero process 
time. Read and write times of the transitions are assu m ed to be 220 
ms and 255 ns for simulation and theoretical performance evaluation 
(these communication times were measured for the testbed in [20] for 
two functional units) . lower bounds for TBIO and TBO are calculated 
for both the test AMG and the transformed test AMG. It is assumed in 
simulations and experiments that no resource is needed to implement a 
dummy transition. Both the AMG's are executed and simulated for two 
functional units which are the maximum resource requirements to 
achieve TBO^ and TBIO^ in either case. Although experimental 
and simulated time performance are expected to be TBIOj^ and 
TBOj^, there can be seme differences due to the following reasons. 

The simulated performance measures are always a little higher than the 
theoretical expected performance. This is due to lost clock cycles in 
assigning transitions to resources and the fact that even a dummy 
transition will also require a resource, though only for a small 
duration. Experimental time performance values are higher in sane 
cases from the theoretical expected time performance due to one or 
more of the following reasons. First, Ethernet cannot implement more 
than one read or write operation at the same time. Second, as the 
dummy transition is nanideal, it requires a resource. Third, read and 
write tines for NMG transitions were measured with no contention, 
which is not true when a number of transitions try to ccmtunicate at 
the same time. Fourth, there is a sli^it increase in actual process 
times for transitions due to interrupt from other functional units. 
Experimental and simulation results for both AMG's are presented in 
Figures 4.10 through 4.13 and ccrpared with theoretical performance 
lower bounds in Table 4.1. The node activity display shews the 
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TABLE 4.1 

COMPARISON OF RESULTS FOR TEST 1 
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Figure 4.10. Simulation results for the AMG in Test 1 
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Figure 4.11. Simulation results for the transformed AMG in Test 1 
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Figure 4.12. Experimental results for the AMG in Test 1 
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Figure 4.13. Experimental results for the transformed AMG in Test 
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execution of transitions with time in the order of transition numbers, 
with transition 1 being the lowest. TBI, TBO, and TBIO of the 
input/output display are to be divided by 100 for converting all times 
to seconds . Fran the input/autput display there is a significant gain 
in TBO by the transformation. Performance varies very little with 
task inputs. From the table, it can be seen that TBOj^ is irproved 
from 13.17s to 8.695s by the dummy transition. It can also be seen 
that the experimental and simulated performances are very close to the 
theoretical lower bounds of performance, except for the TBO of the 
transformed test AMS. This is primarily due to the fact that the read 
of transition 3 and that of the dummy transition in Figure 4.9(b) 
cannot occur at the same time. Also, as there are only two resources 
with the priority of transition 1 being the lowest, no new task input 
will be accepted until the operation of the dummy transition is 
completed. All other results are as expected. 

Test_2. This tes t illustrates the use of control place to reduce 
resource requirements (peak of TRE) while maintaining TBOj^. Also, 
theoretical and experimental time performances are catpared. The test 
AMS and the transformed AMS are shown in Figures 4.14(a) and 4.14(b) 
respectively. The test AMS of Figure 4.14(a) requires three resources 
to operate at TBIO^ and TBO^. The AMS is transformed as shown 
in Figure 4.14(b) which achieves TBO^ with only two resources at 
the expense of increasing TBIO^ (assuming that no resources are 
required for the dummy transition) . All the transition times are 
expressed in seconds. Priority ordering from highest to lowest for 
the AMS of Figures 4.14(a) and 4.14(b) are 4, 2, 3, 1 and 
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5 , 3, 4, 2, 1 respectively. Read and write tires for each NM3 
transition were measured in [20] to be 0.275s and 0.31s respectively 
for three resources. The test MG of Figure 4.14(a) and the 
transformed MG of Figure 4.14(b) are run on the testbed and simulated 
with three and two resources respectively. Experimental and 
simulation results are described in Figures 4.15 through 4.18 and 
ccnpared with theoretical lower bounds in Table 4.2. In Figures 4.15 
through 4.17, TBI, TBIO, and TBO are divided by 100 to get time in 
seconds. The times in the input/output display of Figure 4.18 are 
divided by 18.2 to get time in seconds. It can be observed that the 
transformed MG achieves almost the same TBO as the original AMS, 
however, TBIO is increased by nearly the time for transition 3 of 
Figure 4.14(a) in the experiment and simulation. The differences in 
experimental results from theoretical lower bounds for both the MG’s 
are primarily due to nonideal dummy transition and Ethernet 
comrunication problems, as described in Test 1. The difference in the 
simulation results from the theoretical expected performance is mainly 
due to lost clock cycles in assigning transitions to resources and due 
to nonideal dunnry transitions. The experimental performance for the 
transformed MG unexpectedly went through a wide variation initially. 
One probable reason is the lack of proper injection control, which may 
cause the oonraunication software (for implementing Ethernet 
communication) to be unpredictable. All other results are as 

expected. 

Test 3 . This is a simulation for the execution of a test algorithm 
shown in Figure 4.19(a) to check the AIMM operating point design 
procedure. Let T = 1000 time units. The read and write times of the 
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Rgure 4.16. Simulation results for the transformed AMG in Test 2 
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Figure 4.17. Experimental results for the AMG in Test 2. 
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Figure 4.18. Experimental results for the transformed AMG in Test 2 
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NM3 transitions axe assumed to be zero. Hien TBIO^j = 4T, TTj_g ~ 

5T, and TBOj_g = 3T. No further improvement of TBOjjj is possible 
as it is dete rmined by the time/taken ratio of the recursion circuit. 
Hence, TBIO^ = 4T, TT^ = 5T, and TBO^ = 3T. REST is shewn 
in Figure 4.19(b) . By checking out all TBO > TBO^, Rj^ = 3, 

= 2. Also TC = 8T, TCE = 8T units of oenputer time. As 
fTCE/TBO ALB l = 3, R max cannot be improved any further 
and Strategies B and C cannot be applied. So if R > 3, the AIAMM 
operating point is determined by Step 3 as TBI = 3T, TBIO = 4T, TT - 
5T, and TBO = 3T for all task inputs. As there are no floating 
transitions, Application 4 is not required. For R = 2, Strategy A of 
Step 4 in the AIAM4 operating point design determines TBI = 4T, TBIO = 
4T, TT = 5T, and TBO = 4T for all task inputs. The AMG execution at 
the operating points determined by Steps 3 and 4 are simulated and 
results are described in Figures 4.20 and 4.21 respectively. The 
achieved time performance in simulation is very close to the predicted 
theoretical time performance of the AXNM operating point design. In 
the simulation of the operating point given by Step 3, TBI * 3.02T is 
used instead of 3T because TB0 & tr is slightly higher in the 
simulation due to lost clock cycles. 

T«aert- a . The algorithm of Test 4 is a subsystem of a Spaoe 
Surveillance System and is described in Figure 4.22(a) (ignore the 
dotted line) . Let T = 100 time units. The read and write times of 
NM3 transitions sure assumed to be zero. Then, TBIO^g = TTlB = 

T BI0 ALB = TTaLB * 1ST and TB0j_g = TBO^ = 10T. REST is shown 
in Figure 4.22(b) . By checking cut all TBI > TBO^, R^^ = 4, 
and Rn^ n = 3. Now TCE = 25T units of computer time. As 
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Figure 4.20. Simulation results for AOP of Step 3 in Test 3. 
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Figure 4.21. Simulation results for AOP of Strategy A in Test 3. 






137 


rTCE/TBO AUS l - 3, it may be possible to lower to 3 ' 

A control place is placed fran transition 5 to 3 for that {uipcee, as 
shown by the dotted line in Figure 4.22(a). The new REST is shown in 
Figure 4.23(a) . It was checked by the Ttime program that HSIO^, 

TTuj, and TBOjj, were uncharged by the control place. By checking 

all TB! > 1OT, IW - 3 - Kmin “ 2 ‘ Ifen “' strata 3 ias B 31,3 C 
of the AIAin operating point design axe not appreciate as IVax wl11 
always be equal or more than 3. For R > 3 , Step 3 of the MOTH 
operating point design determines TBI - 1OT and TOIO - TT - 1ST for 
all task inputs. FOr R - 2 Strategy A of the Aram <*eratirg point 
design determines TBI = 17T, TOO - 17T, and IBIO - TT = 1ST. The 
graph play for a single task ani the total graph play for TBO ■ 10T is 
shown in Figures 4.23(b) and 4.24 respectively. By inspection of TCP, 
no dummy transition is required to enforce GEBT and REST. The AMG 
execution at the operating points, determined by Steps 3 and 4, are 
simulated aid the results are described in Figures 4.25 and 4.26 
respectively. The achieved time performance in simulation is very 
close to the predicted time performance of the ATAW operating point 

design. 

Test 5 . Execution of the algorithm marked graph in Figure 3.3 is 
simulated for all the operating points developed in Section 4.2. All 
the process t imes for the transitions of the AMS are nnltiplied by T 
(T = 1000 time units) in the s insolation. Ihe read and write times of 
the NM3 transitions are assumed to be zero. The results of the 
simulation for the operating points of Steps 3 through 6 are described 
in Figures 4.27 through 4.30 respectively. It is to be noted that the 
TBI's used in the simulation for the operating points in Steps 4 
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F,gure 4.25. Simu.otion results for AOP of Step 3 in Test 4 


HOIC ACTIVITY IISPLAY 4“** HffUT/OUTPUT HSFIOV 



Figure 4.26. Simulation results for AOP of Strategy A in Test 4 
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Figure 4.27. Simulation results for AOP of Step 3 in Test 5 
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results for AOP of Strategy B in Test 5. 
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Figure 4.30. Simulation reeults for AOP of Strategy C in Teat 5. 
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through 6 are slightly higher than the value predicted in the KTMM 
operating point design. The reason is, again, a slight increase in 
the transition tires of the WG in the similation due to the time 
needed to assign transitions to resources. 


4.4 Summary 

A new term, the AIAMM operating point (AOP) , is defined to 
express all the parameters of an algorithm execution in the MW M data 
flow architecture. The characteristics of an AOP are explored for 
finite resources and under specified transformations. The absolute 
lower bounds for performance measures are defined. TBIO^g, 

Tr. T o, and TBOitr are determined under transformations by control 
places and dummy transitions. A procedure is developed for operating 
point design given the number of functional units. The performance 
model and the use of dummy transitions and control places for 
inproving time performance and resource requirements are illustrated 
through experiments and simulations. The A3WM operating point design 
methodology is checked by simulations on test algorithms. 



CHAPTER FIVE 


OCNCmSION 

Performance modeling and enhancement for concurrent processing in 
the AIAMi flow architecture have been the primary thrust for this 

research. Several key results are achieved in that respect. First, a 
performance model is developed to determine performance of an 
algorithm executed periodically in the ATMM data flow architecture. 
Second, algorithm transformation techniques are identified and their 
applications are illustrated in improving time performance and 
resource (ccnputing element) requirements. Third, an ATWM operating 
point design procedure is developed to specify time performance and 
input data injection control for periodic execution of an algorithm on 
an ATAMd data flow architecture. Significant results in these three 
awaas have been discussed. Finally, future research topics are 
suggested. 

The starting point of this r esear ch has been to define the 
ccrrputing environment and performance measures for the periodic 
execution of algorithms in the AIAMM data flew architecture. The 
architecture is assumed to have R identical computers, or functional 
units, and executes algorithms according to the males of AIMM. These 
carputers, or functional units, are also denoted by the terms resource 
and ccuputing element. The performance of an algorithm is measured by 
the time between input and output (TBIO) , task time (IT) , and time 
between outputs (TBO) . Graph theoretic and resource irtposed bounds 
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are developed for these performance measu r es. Also, the graph 
execution pattern and resource requirements are defined through GPST, 
REST, TCP, and TRE. These results establish a new model for 
evaluating performance of algorithms in a hardware i n d epen dent context 
as long as the architecture obeys the rules of AXMM. Hence, it is 
now possible to ccnpar e the relative merits of different algorithm 
decompositions with respect to performance and r e so ur ce requirements 
for the A3WM data flew architecture. 

The performance model enables the us er to identify the c a u se of 
performance limitations. It is observed that the critical circuits of 
the CM3 and the criti cal paths of the MAMS are the de ter mining factors 
for the graph theoretic lower bounds of time performance. Also, the 
total resource r equir ement (the peak value of TRE) is determined by 
the shape of the resource envelope (REST) and TBO. Hence, it may be 
possible to enhance performance or reduce resource requirements by 
transforming the algorithm narked graph while maintaining its 
equivalency. Algorithm transformation techniques are identified which 
can be used to improve time performance or aid resource envelope 
modification. Transformation of an AMG may, or may not, involve 
decomposition of transitions. This research has concentrated on two 
of the transformation techniques, namely dunmy transitions and control 
places. Concentration on these techniques is due to their wide range 
of applications, ***«» of implementation, and negligible increase in 
communication time by transformation. The most important contribution 
of this research is the application of dummy transitions which provide 
storage space for output of transitions. Eunrny transitions have made 
parallel path circuits in the CMS insignificant for determining 
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TBOuj. Thus, it is now possible to use control places and duniny 
transitions together to change the REST without increasing TBO^. 

Dummy transitions can improve TBO^ by reducing the time/token ratio 
of dcminant parallel path circuits. Another application of dummy 
transition is to enforce the REST as the resource envelope for all 
task inputs. Hence, it is new possible to enhance the throughput of 
an algorithm execution in the AIN* data flow architecture. Also, the 
algorithm marked graph can be transformed according to the resource 
capability of the architecture or to make the resource need for 

periodic operation predictable. 

The AIN* operating point (AOP) design procedure uses the 
knowledge of the performance model and algorithm transformation to 
specify an operating point for executing an algorithm in the AIN* 
data flow architecture. The only transformations used for the AOP 
design are durtrny transitions as buffer and control places. The AOP 
design describes the procedure to achieve the absolute lewer bound of 
time performance under these transformations. It proposes three 
strategies corresponding to sacrificing pipeline concurrency, parallel 
concurrency, and a combination of both to meet the limited 
availability of resources. Pipeline and parallel concurrency can be 
reduced by reducing input data injection rate or by transforming the 
AMS to modify the shape of REST respectively. Although the design 
procedure is partially heuristic because of the NP completeness of the 
problem, it allows the user to make a trade-off between pipeline and 
parallel concurrency for limited availability of resources. 

Test algorithms are simulated by a PC-based simulator [21] to 
validate the AIN* operating point design procedure. The read and 
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write tiroes of transitions are assumed to be zero. Process t i mes of 
transitions are in the order of hundreds of clock cycles to keep the 
algorithms at a large-grain level. This order of transition times are 
ap p r opriate as the simulator takes le s s than ten clock cycles for 
assigning transitions to resources. EXmrny transitions and control 
places are realized as regular active transitions (of zero process 
time) or active places respectively. It is ass umed that a dumny 
transition does not require a resource. Simulated performance of 
algorithms are always very close to that predicted by the AOP design 
(within 2.1% for TBIO and within 5.8% for TBI and TBO) . One 
significant observation is that the proper input data injection 
interval in the simulation is slightly higher than that predicted by 
the AOP design (within 5.8%) . These differences between theoretical 
and s imulated results are mainly due to a slight increase in 
transition ti m es by the unaccounted clock cycles in assigning 
transitions to resources. 

Test algorithms are executed on a testbed A3MM data flew 
architecture [20] to verify the performance model and the use of dummy 
transitions and control places for transformation of algorithms. 

Dummy transitions and control places are implemented as active 
transitions of zero process time and active places respectively . Read 
and write times for the transitions in the experiments are assumed to 
be those measured in [20] . The largest process time among the 
transitions of the test algorithm is kept at least ten times higher 
than read or write times for maintaining algorithms in the large-grain 
level. The performance model is verified as experimental time 
performances are close to theoretical time performances (within 4.4% 
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for TBIO and within 9.8% for TBO) . The use of dunny transitions for 
making parallel path circuits insignificant is verified in Test 1. 

The TBO of the transformed AMS in Test 1 is determined by the 
time/token ratio of the largest process circuit (experimental TBO is 
6.15% more) . A control place and a dummy transition together in Test 
2 have reduced the total resource requirement frcm 3 to .. while 
maintaining the change in TBO within 3%. The larger difference 
between the experimental and theoretical results compared to the 
simulation can be attributed mainly to two reasons. First, 
implementing a dumny transition as an active transition has a nuch 
greater effect in the testbed. The dummy transition requires read and 
write thuss in the experiments and hence, requires a resource for a 
considerable amount of time contrary to the assumption. Second, as 
pointed out in [20] , Ethernet cannot implement concurrent read or 
write operations. This fact is not taken into account in the 
measurement of read and write times. The experimental results suggest 
that a better method of implementing a dumny transition and a more 
accurate ocnnunication model for read and write ti m es are necessary. 

There are several topics that can be the subject of future 
research. On the theoretical side, the following problems need 
attention. In order to properly decompose an algorithm, a specific 
definition of large granularity is needed corresponding to the 
ccmunication time of an A1MM data flow architecture. The first step 
is to develop a general and more accurate mode l for read and write 
times. The use of dumny transitions of finite time, control places 
with initial tokens, and predefined tokens in performance improvement 
and reduction of resource requirements needs to be explored. 
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Experiments and simulations have shewn that the proper input data 
injection interval is slightly higher than the predicted value. This 
observation and the possibility of slight variation in transition 
times suggest that automatic injection control may be necessary. 
Execution of multiple MB's or AMS's with multiple input and output 
transitions provide a ccnplex, but interesting, topic of future 
research. Finally, the performance of algorithms with conditional 
data flow need to be analyzed. On the ii^lementation side, realizing 
dummy transitions as buffers in the functional unit or graph manager, 
a better technique for measuring camunication times, a fully 
automated A3MM operating point design procedure, and transformations 
of algorithms by dumny transitions and control places in real time are 
useful topics for future research. 
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APPENDIX 


This appendix is an excerpt from [11]. The AIMM model is 
studied analytically to determine important graph operating 
characteristics. First, a state description which expresses the next 
graph marking as a function of the present marking and a vector 
indicating which transition is to be fired is developed. Then the 
marked graph properties of reachability, liveness, and safeness are 
considered for the CM3. TWo excellent papers by Murata [13, 18] an 
properties of marked graphs are the sources for nuch of the material 

presented in this appendix. 

Let G be a marked graph consisting of m places and n 
transitions. The m-vector M* denotes the marking vector for G 
resulting from the firing of seme sequence of k transitions. The 
following two definitions are necessary to develop the state 
description of the CMS. 

Definition A . } : Ocnclete Incidence Matrix The ccmplete incidence 

matrix for a marked graph G is the (n x m) matrix A - [*ij] having 
rows corresponding to transitions and columns corresponding to places 

and where 

a _ | + i (-i) (if place j is incident at transition i 

I and directed out of (into) the transition} 

I o if place j is not incident at transition j. 
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ryfinihion A. 2 ; w—ttarv Firing Wjgtgr - An elementary firing 
vector is an n-vector having all zero entries except for the 
jth oc^onent, which is 1 denoting that transition i is the k^ 1 
transition to fire in seme transition firing sequence. 

To gain insight to the state equation description, it is helpful 

to consider the firing of transition k. If = ”1 (+D * P lace 1 

Is an input (output) place to transition k. therefore, transition k 
is enabled if M(i) « 1 for each inpit place. When transition k fires, 
one token is removed firm each inpit place and cne token is added to 
each output place, these chservations lead to the following next 
state description for a marked graph. 

PT^prtv A. 1: aatst Description. For a marked graph G with 

present marking vector and elementary firing vector i*, the 

next marking vector is given by 

Mjc = ^c-i + ATu k* 

The next state description can be used to express the graph 
marking resulting from the application of sequences of elementary 
firing vectors. This is done in the next definition and property. 

npfinition A. ^ Firing Count Vector- ^ < u l' u 2'“*' u d ) a 
sequence of elementary f iring vectors taking a marked graph G from an 
initial marking Mg to a destination marking 1%. The firing count 
vector x d for this firing sequence is defined by 





initial marking vector Mq, the marking vector resulting frcin the 
application of an elementary firing vector sequence 
(u,, u 2 ,...,u d ) is given by 


Md = Mq + 


Using the state description of a marked graph as a basis, the 
property of reachability is investigated. Necessary and sufficient 
conditions for a OC marking vector to be reachable frcm an initial 
marking are established, and it is shown that the nmtber of tokens 
contained in any directed circuit of the CMS is invariant under 

transition firings. 

npfinition A.4 ; Reachability. A marking 1% is reachable frcm an 
initial narking Mq if there exists a sequence of elementary firing 
vectors that transforms to 

The following definition is required to state the reachability 


conditions for a CMS. 


rv»finition A.5: ^^mental Circuit Hatri* lot T be a tree of 

connected marked graph G. The set of (m-nfl) Circuits, each uniquely 


formed by appending one cotree edge to the tree, is called the set of 
fundamental circuits of G for tree T [28]. The fundamental circuit 


matrix for G for tree T is the (m-n+1) x (m) matrix B f - 
having tews corresponding to fundamental ciroiits and columns 
corresponding to places, and where b^ is determined by the rules as 


described on the next page. 
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| +1(-1) if Place j is contained in f-circuit i and the 
| p la c° and circuit directions agree (disagree) 

b ij = ' 

| if place j is not contained in f-circuit i. 

Re ^Knitv intbeOC. in a oc^itational mark- 
graj* G, a markii>J Ma is reachable Iran an Initial marking Mq if 
ani only if = Bjtfe, vhere B, is a tunflamental circuit 

matrix for G. 

Proof. It is shown in [13] (Theorem 3) that the property is true for 
marked graphs containing no token-free directed circuits. By the 
construction rules for the OC, directed circuits occur in exactly 
four ways. First, each NMS consists of a directed circuit which 
contains an initial marking token in the Process Ready place. Second, 
a directed circuit is formed each time an NMS is linked to another 
MC. Since one of the two linking places contains an initial marking 
token and both places are contained in the circuit, this circuit is 
never token free. Third, directed circuits exist in the CMS 
corresponding to interconnected feedforward paths in the algorithm 
marked graph. Each such circuit contains one or more backward 
directed control edge containing one initial marking token. Fourth, 
directed circuits exist in the CMS corresponding to directed circuits 

in algorithm marked graph. Each such circuit contains exactly one 

forward directed edge containing one initial marking token which 

represents initial condition data. Therefore, the CMS contains no 

token-free directed circuits and the property follows. 



160 


As a direct consequence of the reachability property of the CMS, 
it can be shown that the number of tokens in any directed circuit is 
constant. This characteristic is stated as Property A.4. 
p^vA.4: Token invars- In a CMS, the nuntoer of tokens 

contained in a directed circuit is invariant under transition firing. 
Proof, consider a directed circuit C of a CMS. The entries in the 


row of a circuit matrix B corresponding to C are +1 in oolumns 
representing edges in C and are 0 otherwise. If M is a marking 
vector, the component of EM corresponding to C is equal to the number 
of tokens in directed circuit C marking M. Therefore, if M* is any 
marking reachable from an initial marking Mq» ifc follows fran 
Property A.3 that E^ = Bfc. That is, the number of tokens in 
directed circuit C under initial marking Mq is equal to the number 
of tokens under any marking reachable fran Mq. This acmpletes 

the proof. 

Next, liveness and a closely related property called consistency 
are considered. It is shewn that the CMG is live and consistent. 

p^n^nnA.6: Liveness . A marked graph G is said to be live for a 

marking F if, for all markings reachable from M, it is possible to 
fire any transition of G by progressing through seme transition firing 


sequence. 

as, rtuer^ss in the CMS . computational narked graph is 

live for sill appropriate initial marking vectors. 

Proof. It is shown in [18] (Property 2) that a marked graph G is live 
for a marking M, if and only if, G contains no token-free directed 
circuits in marking M. As stated in the proof of Property A.3, for 
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all appropriate initial markings Mq, the CMS contains no token-free 
directed circuits. Therefore, the property follows. 
npf-inition a. 7: Consistency . A marked graph G is said to be 

co n siste n t if there exists a narking M and a transition firing 
sequence S from M back to M such that every transition occurs at least 

once in S. 

A.6: consistency in the QC. A connected ccnputaticnal 

marked graph G is consistent. In addition, each transition of G 
occurs an equal nuntoer of times in a firing sequence from a marking M 

back to M. 

Proof. From Property A.2, if a CM3 is consistent then there exists a 
marking = Mq and a firing count vector x^ > O such that 

= 0. The converse is also true. The incide n ce matrix for a 
marked graph G is an (n x m) matrix A. If G is connected, then it is 
known [28] that the rank of A is n-1, and thus the null space of A 
has dimension one. It is observed that each row of A T has one (1) , 
one (-1) , and all remaining terms are zero (0) . Therefore, if Cj 
denotes the column of A^ , it follows that 

n 

E C-s = 0 . 

j=l 

Thus, there exists a vector = [k k. ...k]*^, k > 0, which 
uniq uel y satisfies A^x^ = 0. This completes the proof. 

The fined graph property considered in this section is safeness. 
This property is first defined and then it is shewn that a CMS is 


safe. 
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p^fimtion A-8 ; Safeness . A marked graph G is said to be safe for 
marking M if, for all markings reachable fran M, no place oontains 
nore than one token. 

Pmngrtv A. 7: Safeness in the CMS . The cxnputaticnal marked graph is 

safe for all appropriate initial marking vectors. 

Proof. By Property A.4, the token count for each directed circuit of 
the CMG is invariant under transition firing. Therefore, it is 
sufficient to show that each edge of the CMS belongs to at least one 
directed circuit containing a single token. By the construction rules 
for the CMS, all CMS edges can be classified into two groups NM3 edges 
and linking edges. NM3 edges occur in groups of three and always form 
a directed circuit containing one token. Linking edges occur in 
pairs, one forward directed and one backward directed, and also form a 
directed circuit with the forward directed edges of the NMG. One of 
the linking edges, but not both, always oontains one token while the 
forward directed edges of the NMS contain no tokens. Therefore, each 
edge of the CMS is contained in a directed circuit with one token, and 
the property follows. 




